Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
prithivMLmods
/
Llama-3.2-3B-GGUF
like
8
Text Generation
Transformers
GGUF
yahma/alpaca-cleaned
English
llama
Llama3.2-3B
Llama-cpp
F16
16-bit
Q4
Q5
Q8
8-bit precision
4-bit precision
Inference Endpoints
License:
creativeml-openrail-m
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Llama-3.2-3B-GGUF
1 contributor
History:
6 commits
prithivMLmods
Update README.md
9e246c8
verified
3 days ago
.gitattributes
Safe
1.78 kB
Upload 4 files
6 days ago
Llama-3.2-3B-GGUF.F16.gguf
Safe
6.43 GB
LFS
Upload 4 files
6 days ago
Llama-3.2-3B-GGUF.Q4_K_M.gguf
Safe
2.02 GB
LFS
Upload 4 files
6 days ago
Llama-3.2-3B-GGUF.Q5_K_M.gguf
Safe
2.32 GB
LFS
Upload 4 files
6 days ago
Llama-3.2-3B-GGUF.Q8_0.gguf
Safe
3.42 GB
LFS
Upload 4 files
6 days ago
README.md
Safe
4.43 kB
Update README.md
3 days ago
config.json
Safe
29 Bytes
Upload config.json
6 days ago