Failing. Missing tokenizer.model

#1
by rjmehta - opened

OSError: Not found: "~/TheBloke_deepseek-llm-67b-chat-GPTQ/tokenizer.model": No such file or directory Error #2
@TheBloke

ExLlama doesn't supports models without tokenizer.model. But there was a patch to ExLlama v2 last night that adds support

Thanks for the info!

I made a pr for textgen webui here to bump its exllamav2 to latest https://github.com/oobabooga/text-generation-webui/pull/4782

Sign up or log in to comment