Having issues with cloning lfs files
I can't clone those safetensors model files now. I'm cloning via SSH. Several days ago seemed to be fine.
git clone [email protected]:meta-llama/Meta-Llama-3-8B
Cloning into 'Meta-Llama-3-8B'...
remote: Enumerating objects: 42, done.
remote: Counting objects: 100% (15/15), done.
remote: Compressing objects: 100% (12/12), done.
remote: Total 42 (delta 9), reused 3 (delta 3), pack-reused 27 (from 1)
Receiving objects: 100% (42/42), 4.49 MiB | 10.13 MiB/s, done.
Resolving deltas: 100% (9/9), done.
Downloading model-00001-of-00004.safetensors (5.0 GB)
Error downloading object: model-00001-of-00004.safetensors (f2c1441): Smudge error: Error downloading model-00001-of-00004.safetensors (f2c144103072514542e327fa8080bd375cb300f2d453fba9ca3aea81d0d4cf33): batch request: unexpected end of JSON input
Errors logged to '/Users/jack/Meta-Llama-3-8B/.git/lfs/logs/20240503T195307.381245.log'.
Use `git lfs logs last` to view the log.
error: external filter 'git-lfs filter-process' failed
fatal: model-00001-of-00004.safetensors: smudge filter lfs failed
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry with 'git restore --source=HEAD :/'
Same issue!
@JaaackXD Did you try other hf repos? Seems like the same issue also happens on other hf repos.
Same issue!
Error downloading object: model-00001-of-00004.safetensors (f2c1441): Smudge error: Error downloading model-00001-of-00004.safetensors (f2c144103072514542e327fa8080bd375cb300f2d453fba9ca3aea81d0d4cf33): batch request: unexpected end of JSON input
Errors logged to '/Users/proto/sourceCode/ollama/model/.git/lfs/logs/20240504T222126.842679.log'.
Use git lfs logs last to view the log.
error: external filter 'git-lfs filter-process' failed
fatal: model-00001-of-00004.safetensors: smudge filter lfs failed
warning: Clone succeeded, but checkout failed.
You can inspect what was checked out with 'git status'
and retry with 'git restore --source=HEAD :/'
After some research and trying a bunch of solutions from both StackOverflow and ChatGPT, I think this is not the LLaMA issue but the issue with git-lfs on its own. (I tried to clone other repos via SSH, which also contained large files, and also failed.)
I haven't found a clear way to use git-lfs to clone the correct large files via SSH. But it should work fine via HTTPS. (https://stackoverflow.com/questions/69335691/azure-devops-git-repo-ssh-failed-to-download-lfs-files-while-https-works-fine)
So, if you guys are having authentication issues when you clone via HTTPS with Meta, feel free to clone the original LLaMA 3 models from my repo via HTTPS without any authentication needed! 🤗 (https://huggingface.co/JaaackXD)
should be fixed soon
thanks for the reports 🫡
It's fixed, closed for now.