Add missing tokenizer files
#2
by
Xenova
HF staff
- opened
So now we can use AutoTokenizer.from_pretrained('minishlab/M2V_base_output')
Nice, thanks! We're going to add this by default in version 1.0.0, but this is nice as a manual work-around.
stephantulkens
changed pull request status to
merged