col-minilm / tokenizer.json
Jo Kristian Bergum
clean up tokenizer and add [unused0] and [unused1] as special tokens
85b42e5
raw
history
902 kB
File too large to display, you can check the raw version instead.