Autocomplete?

by wcde - opened Sep 5

wcde

Sep 5

It is support FIM-compatible autocomplete? I don't see any FIM tokens in tokenizer. With generic chat/instruct template autocomplete obviously doesn't work.

CISCai

Sep 5

There are FIM tokens (see my GGUFs), however they do not appear to have been used during training as they are not giving very good results, and only with SPM infill, which might suggest the model is just doing regular generation continuation.

lorinma

01-ai org Sep 5

yup, it's not very good at FIM tasks because it has some negative effects during training, thus we didn't talk about it in our blog and README. Something we'll need to figure out

lorinma changed discussion status to closed Sep 25

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment