CohereForAI/c4ai-command-r-v01 · Could not locate the tokenization_cohere

Apr 4

•

Could not locate the tokenization_cohere_fast.py inside CohereForAI/c4ai-command-r-v01.
Traceback (most recent call last):
  File "/admin/home/llm/Synthetic-Text/.h80i-env/lib/python3.10/site-packages/huggingface_hub/utils/_errors.py", line 304, in hf_raise_for_status
    response.raise_for_status()
  File "/admin/home/llm/Synthetic-Text/.h80i-env/lib/python3.10/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/CohereForAI/c4ai-command-r-v01/resolve/main/tokenization_cohere_fast.py

ahmetustun

Cohere For AI org Apr 5

Hi, could you update the transformers and use the model without trust_remote_code? You may need to clean command-r module from the huggingface cache as well.

velocivirus

Apr 8

I happened to encounter the same problem, but removing the trust_remote_code works!

Qubitium

Apr 9

•

edited Apr 9

@ahmetustun the bug is cohere including unnecessary config in json: fixed in PR https://huggingface.co/CohereForAI/c4ai-command-r-v01/discussions/48

ahmetustun changed discussion status to closed Apr 10