Hugging Face's logo

LoneStriker
/
Crunchy-onion-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
1
LoneStriker commited on
Commit
534b944
•
1 Parent(s): 060291c

Upload folder using huggingface_hub

Browse files
Files changed (11) hide show
  1. .gitattributes +9 -0
  2. Crunchy-onion-Q2_K.gguf +3 -0
  3. Crunchy-onion-Q3_K_L.gguf +3 -0
  4. Crunchy-onion-Q3_K_M.gguf +3 -0
  5. Crunchy-onion-Q3_K_S.gguf +3 -0
  6. Crunchy-onion-Q4_K_M.gguf +3 -0
  7. Crunchy-onion-Q4_K_S.gguf +3 -0
  8. Crunchy-onion-Q5_K_M.gguf +3 -0
  9. Crunchy-onion-Q5_K_S.gguf +3 -0
  10. Crunchy-onion-Q6_K.gguf +3 -0
  11. README.md +15 -0
.gitattributes CHANGED
@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Crunchy-onion-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Crunchy-onion-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Crunchy-onion-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Crunchy-onion-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Crunchy-onion-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Crunchy-onion-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Crunchy-onion-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Crunchy-onion-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Crunchy-onion-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Crunchy-onion-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86a15ca05b2d3ba70a53fe02a6297952b96e075a7b173ed1765faffaadc65c7a
3
+ size 17309173408
Crunchy-onion-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:482f62106d275096cd069517f0b6f879e1deeb9945a372b961110cce8f6c8823
3
+ size 24167589536
Crunchy-onion-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:441401c192df310bd609ac1605cccfe44d600ac3901e568ff11efcd348a617cd
3
+ size 22544393888
Crunchy-onion-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bec23337c1009ccebef591a46565fd3fdbb91e98dcd4c722e67b028a159b02a
3
+ size 20430464672
Crunchy-onion-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:860510e4ad96df5ba55f2c28ce992fe80cd2940344c3ca96faac422bdcca992c
3
+ size 28446410400
Crunchy-onion-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78e4a16dcf6fadcae200f564abd1316d4da73c0ffbe14cddf624ee341546b9ea
3
+ size 26743522976
Crunchy-onion-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5e04b41ccee7a5f6cb640375fe8c913b834632089f8d0157decc8af24ebc26a
3
+ size 33227523744
Crunchy-onion-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85a6371ae635725eb1105da9fcdf809d3fef56bd8fa7b13e9a58d451f1e33864
3
+ size 32229279392
Crunchy-onion-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad5afd8e50805ba951c50027e9168274f07fd508005c56b85daf3cc133fb8cbe
3
+ size 38378759840
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: agpl-3.0
3
+ datasets:
4
+ - lemonilia/LimaRP
5
+ - grimulkan/theory-of-mind
6
+ - Epiculous/Gnosis
7
+ ---
8
+
9
+ # Crunchy-onion
10
+
11
+ This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).
12
+
13
+ The 4-bit qlora was then merged into Mixtral Instruct resulting in what you see here.
14
+
15
+ Works best with ChatML Instruct