Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MarsupialAI
/
Magnum-12b-v2_iMatrix_GGUF
like
0
Text Generation
GGUF
9 languages
chat
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Magnum-12b-v2_iMatrix_GGUF
1 contributor
History:
9 commits
MarsupialAI
Upload Magnum-12b-v2-imatrix.dat
49d15f7
verified
3 months ago
.gitattributes
Safe
2.37 kB
Upload Magnum-12b-v2-imatrix.dat
3 months ago
Magnum-12b-v2-imatrix.dat
Safe
7.05 MB
LFS
Upload Magnum-12b-v2-imatrix.dat
3 months ago
Magnum-12b-v2_Q3km.gguf
Safe
6.08 GB
LFS
Upload 3 files
3 months ago
Magnum-12b-v2_Q4km.gguf
Safe
7.48 GB
LFS
Upload 3 files
3 months ago
Magnum-12b-v2_Q4ks.gguf
Safe
7.12 GB
LFS
Upload 3 files
3 months ago
Magnum-12b-v2_Q5km.gguf
Safe
8.73 GB
LFS
Upload 3 files
3 months ago
Magnum-12b-v2_Q5ks.gguf
Safe
8.52 GB
LFS
Upload 3 files
3 months ago
Magnum-12b-v2_Q6k.gguf
Safe
10.1 GB
LFS
Upload 3 files
3 months ago
Magnum-12b-v2_fp16.gguf
Safe
24.5 GB
LFS
Upload Magnum-12b-v2_fp16.gguf
3 months ago
Magnum-12b-v2_iQ2m.gguf
Safe
4.44 GB
LFS
Upload 2 files
3 months ago
Magnum-12b-v2_iQ2xxs.gguf
Safe
3.59 GB
LFS
Upload 2 files
3 months ago
Magnum-12b-v2_iQ3m.gguf
Safe
5.72 GB
LFS
Upload 4 files
3 months ago
Magnum-12b-v2_iQ3xxs.gguf
Safe
4.95 GB
LFS
Upload 4 files
3 months ago
Magnum-12b-v2_iQ4nl.gguf
Safe
7.1 GB
LFS
Upload 4 files
3 months ago
Magnum-12b-v2_iQ4xs.gguf
Safe
6.74 GB
LFS
Upload 4 files
3 months ago
README.md
Safe
264 Bytes
Create README.md
3 months ago
groups_merged.txt
Safe
201 kB
Upload groups_merged.txt
3 months ago