Autocomplete?
#5
by
wcde
- opened
It is support FIM-compatible autocomplete? I don't see any FIM tokens in tokenizer. With generic chat/instruct template autocomplete obviously doesn't work.
yup, it's not very good at FIM tasks because it has some negative effects during training, thus we didn't talk about it in our blog and README. Something we'll need to figure out
lorinma
changed discussion status to
closed