Llama2 Format

[DavidGOrtega]

LLama 2 official format seems to be

<s>[INST] <<SYS>>
{{ system_prompt }}
<</SYS>>

{{ user_message }} [/INST]

however this is not what I found here.

Is this correct?

[gsuuon]

Hi! Can you link to where you found that documentation? I think I based mine off of their blog post IIRC, but I have seen some variants around.

[DavidGOrtega]

here and here

[gsuuon]

Thanks! And good catch, I must've remembered wrong - should be fixed in 0.2.5.