Hugging Face's logo

MarsupialAI
/
Magnum-12b-v2_iMatrix_GGUF

Text Generation
GGUF
chat
Inference Endpoints
imatrix
conversational
Model card Files Community
MarsupialAI commited on
Commit
4da95bb
•
1 Parent(s): 73f30f3

Upload 4 files

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. Magnum-12b-v2_iQ3m.gguf +3 -0
  3. Magnum-12b-v2_iQ3xxs.gguf +3 -0
  4. Magnum-12b-v2_iQ4nl.gguf +3 -0
  5. Magnum-12b-v2_iQ4xs.gguf +3 -0
.gitattributes CHANGED
@@ -42,3 +42,7 @@ Magnum-12b-v2_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
42
  Magnum-12b-v2_Q6k.gguf filter=lfs diff=lfs merge=lfs -text
43
  Magnum-12b-v2_iQ2m.gguf filter=lfs diff=lfs merge=lfs -text
44
  Magnum-12b-v2_iQ2xxs.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
42
  Magnum-12b-v2_Q6k.gguf filter=lfs diff=lfs merge=lfs -text
43
  Magnum-12b-v2_iQ2m.gguf filter=lfs diff=lfs merge=lfs -text
44
  Magnum-12b-v2_iQ2xxs.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Magnum-12b-v2_iQ3m.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Magnum-12b-v2_iQ3xxs.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Magnum-12b-v2_iQ4nl.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Magnum-12b-v2_iQ4xs.gguf filter=lfs diff=lfs merge=lfs -text
Magnum-12b-v2_iQ3m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b9a3e66fa8999e9b9234bf5f6b8660f75b7b881ecb5fdf8157e9c819eb76cc3
3
+ size 5722231680
Magnum-12b-v2_iQ3xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e8d8065b9cbd20c5db42e6f593842058ac12fa6d6a8709338923cc7cfc6cba4
3
+ size 4945384320
Magnum-12b-v2_iQ4nl.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6947f0f16c044b0ba49e154fb1cf8c43e7252e072a20e321568d850520dcc77
3
+ size 7097914240
Magnum-12b-v2_iQ4xs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa518737259db18f889c56573840e893114945a824a20ca875ebee1f80d82470
3
+ size 6742709120