missing tokenizer?

#1
by mradermacher - opened

it seems the tokenizer of this model is missing? (at least v1 and v1.1 had one).

HiTZ zentroa org

Hi @mradermacher !

The tokenizer is the same as the original Llama 2, and other versions of Latxa. I have uploaded the tokenizer in the recent commit, so it should work now.

Thank you for notifying us!

Best,
Oscar

OSainz changed discussion status to closed

Sign up or log in to comment