Upload tokenizer.model

#3
by emozilla - opened

Add the SentencePiece tokenizer, which is needed by some workflows/trainers

https://huggingface.co/mistralai/Mistral-7B-v0.1/blob/main/tokenizer.model

Amazon Web Services org

Thanks for the PR, approved! @emozilla

yinsong1986 changed pull request status to merged

Sign up or log in to comment