NyxKrage
/

llama3-42b-v0-imat-gguf

Inference Endpoints

Model card Files Files and versions Community

llama3-42b-v0-imat-gguf

1 contributor

History: 11 commits

NyxKrage's picture

Upload llama3-42b.IQ2_XXS.gguf with huggingface_hub

f95742d verified 7 months ago

.gitattributes

1.93 kB

Upload llama3-42b.IQ2_XXS.gguf with huggingface_hub 7 months ago
README.md

261 Bytes

Create README.md 7 months ago
llama3-42b.IQ2_XXS.gguf

11.9 GB
LFS

Upload llama3-42b.IQ2_XXS.gguf with huggingface_hub 7 months ago
llama3-42b.IQ4_XS.gguf

23.3 GB
LFS

Upload llama3-42b.IQ4_XS.gguf with huggingface_hub 7 months ago
llama3-42b.Q4_K_M.gguf

26.1 GB
LFS

Upload llama3-42b.Q4_K_M.gguf with huggingface_hub 7 months ago
llama3-42b.Q4_K_S.gguf

24.7 GB
LFS

Upload llama3-42b.Q4_K_S.gguf with huggingface_hub 7 months ago
llama3-42b.Q5_K_M.gguf

30.6 GB
LFS

Upload llama3-42b.Q5_K_M.gguf with huggingface_hub 7 months ago
llama3-42b.Q5_K_S.gguf

29.8 GB
LFS

Upload llama3-42b.Q5_K_S.gguf with huggingface_hub 7 months ago
llama3-42b.imat

15 MB
LFS

Upload llama3-42b.imat with huggingface_hub 7 months ago