Hugging Face's logo

TheDrummer
/
UnslopNemo-12B-v2-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
6
TheDrummer commited on
Commit
9190a4b
•
1 Parent(s): 85d48a3

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. Rocinante-12B-v2d-BF16.gguf +3 -0
  3. Rocinante-12B-v2d-F16.gguf +3 -0
  4. Rocinante-12B-v2d-Q2_K.gguf +3 -0
  5. Rocinante-12B-v2d-Q3_K_M.gguf +3 -0
  6. Rocinante-12B-v2d-Q4_K_M.gguf +3 -0
  7. Rocinante-12B-v2d-Q5_K_M.gguf +3 -0
  8. Rocinante-12B-v2d-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Rocinante-12B-v2d-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Rocinante-12B-v2d-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Rocinante-12B-v2d-BF16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Rocinante-12B-v2d-F16.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Rocinante-12B-v2d-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Rocinante-12B-v2d-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Rocinante-12B-v2d-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Rocinante-12B-v2d-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Rocinante-12B-v2d-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Rocinante-12B-v2d-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:385fec4e39673021250c5ac371e46206d32bf9b606d593117b413e62e3fee3d9
3
+ size 24504317120
Rocinante-12B-v2d-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba87509fbfd9171bfb57134183c3c38a500f5dcc32bc26579452a46c19f5528a
3
+ size 24504317120
Rocinante-12B-v2d-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:486897732bb0224072d2978dc926ef28ce7068368be57076f043c08588d32824
3
+ size 4791059136
Rocinante-12B-v2d-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d5d89f26a5c4a17c3f4e975df03c5d867e0f81397a7a226bacdb2d165d73150
3
+ size 6083102432
Rocinante-12B-v2d-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c143977d1abbfa040483b0145f9d1bc924523d194f2eea9f06fad3a229a95b08
3
+ size 7477218336
Rocinante-12B-v2d-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ca061503a85eb9068623ec8e204c4b99fe0e0ea04e857cb759d08143ab30cf1
3
+ size 8727646496
Rocinante-12B-v2d-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e352514201bf18311d098043b4790d95c91016d1e49d12cb45cafc4ded5e83c0
3
+ size 10056226432