Hugging Face's logo

Lewdiculous
/
Moistral-11B-v2-GGUF-IQ-Imatrix-Testing

GGUF
Inference Endpoints
Model card Files Community
1
Lewdiculous commited on
Commit
70c3b43
•
1 Parent(s): 16761b6

Q5_K_M, Q5_K_S

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. Moistral-11B-v2-Q5_K_M-imat.gguf +3 -0
  3. Moistral-11B-v2-Q5_K_S-imat.gguf +3 -0
.gitattributes CHANGED
@@ -40,3 +40,5 @@ Moistral-11B-v2-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  Moistral-11B-v2-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Moistral-11B-v2-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
  Moistral-11B-v2-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
40
  Moistral-11B-v2-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
41
  Moistral-11B-v2-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
  Moistral-11B-v2-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Moistral-11B-v2-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Moistral-11B-v2-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
Moistral-11B-v2-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f24b9a0fefb90ea1b4d7d88c6144b39d816a78767a5ba07ff55ad56bae1f128b
3
+ size 7597930624
Moistral-11B-v2-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cc696bc2a32dfa280d048be6bf82b558f15b60ab560f47211f11b602a174899
3
+ size 7397390464