Some mistake using <s> and </s>
#4
by
qwertyuu
- opened
It seems that, in the readme of mixtral, they explain the difference between [INST] and <s> as respectively a string and a token
"Note that and are special tokens for beginning of string (BOS) and end of string (EOS) while [INST] and [/INST] are regular strings."
As seen in the "instruction format" section of the readme here: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1
Just so you know!
Thanks for making this cute and available app for us!
[INST] Instruction [/INST] Model answer [INST] Follow-up instruction [/INST]