Commit History

q8_0: Fast conversion. High resource use, but generally acceptable.
f161601
verified

datatab commited on

q6_k: Uses Q6_K for all tensors
8ac54d6
verified

datatab commited on

q5_k_s: Uses Q5_K for all tensors
e6c942d
verified

datatab commited on

q5_k_m: Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q5_K
5e97c4c
verified

datatab commited on

q5_0: Higher accuracy, higher resource usage and slower inference.
a08886e
verified

datatab commited on

q4_k_s: Uses Q4_K for all tensors
efa4de9
verified

datatab commited on

q4_k_m: Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q4_K
212c3cf
verified

datatab commited on

q4_0: Original quant method, 4-bit.
9ee0070
verified

datatab commited on

q3_k_s: Uses Q3_K for all tensors
0d26fa1
verified

datatab commited on

q3_k_m: Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K
6458855
verified

datatab commited on

q3_k_l: Uses Q5_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K
6cc55a8
verified

datatab commited on

q2_k: Uses Q4_K for the attention.vw and feed_forward.w2 tensors, Q2_K for the other tensors.
0cdc79d
verified

datatab commited on

Create config.json
ccecd96
verified

datatab commited on

Delete config.json
0199fc6
verified

datatab commited on

q3_k_xs" : "3-bit extra small quantization
f68942a
verified

datatab commited on

(Trained with Unsloth)
4928967
verified

datatab commited on

(Trained with Unsloth)
fb5206a
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q4_0.gguf to YugoGPT-Quantized-GGUF.Q4_0.gguf
b38e8ce
verified

datatab commited on

(Trained with Unsloth)
c643e93
verified

datatab commited on

(Trained with Unsloth)
191a866
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q6_K.gguf to YugoGPT-Quantized-GGUF.Q6_K.gguf
da3d8b4
verified

datatab commited on

(Trained with Unsloth)
cad0b77
verified

datatab commited on

(Trained with Unsloth)
f703624
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q5_K_S.gguf to YugoGPT-Quantized-GGUF.Q5_K_S.gguf
d8ffd3f
verified

datatab commited on

(Trained with Unsloth)
13ed2fb
verified

datatab commited on

(Trained with Unsloth)
2b38fcc
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q5_0.gguf to YugoGPT-Quantized-GGUF.Q5_0.gguf
12f8ad0
verified

datatab commited on

(Trained with Unsloth)
0aa4625
verified

datatab commited on

(Trained with Unsloth)
aa8033b
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q4_K_S.gguf to YugoGPT-Quantized-GGUF.Q4_K_S.gguf
fadf3f5
verified

datatab commited on

(Trained with Unsloth)
36ff254
verified

datatab commited on

(Trained with Unsloth)
7597e91
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q3_K_L.gguf to YugoGPT-Quantized-GGUF.Q3_K_L.gguf
47190b9
verified

datatab commited on

(Trained with Unsloth)
85440e2
verified

datatab commited on

(Trained with Unsloth)
f94d1eb
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q2_K.gguf to YugoGPT-Quantized-GGUF.Q2_K.gguf
b2e1de6
verified

datatab commited on

(Trained with Unsloth)
127ec0a
verified

datatab commited on

(Trained with Unsloth)
989f98e
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q3_K_S.gguf to YugoGPT-Quantized-GGUF.Q3_K_S.gguf
3105049
verified

datatab commited on

(Trained with Unsloth)
6c646f1
verified

datatab commited on

(Trained with Unsloth)
11fa5df
verified

datatab commited on

Rename YugoGPT-Quantize-GGUF.Q4_K_M.gguf to YugoGPT-Quantized-GGUF.Q4_K_M.gguf
eba0726
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q5_K_M.gguf to YugoGPT-Quantized-GGUF.Q5_K_M.gguf
363ae96
verified

datatab commited on

(Trained with Unsloth)
1e8896c
verified

datatab commited on

(Trained with Unsloth)
abdc151
verified

datatab commited on

Rename YugoGPT-Quantized-GGUF-unsloth.Q3_K_M.gguf to YugoGPT-Quantized-GGUF.Q3_K_M.gguf
8fdcd43
verified

datatab commited on

(Trained with Unsloth)
2ae469f
verified

datatab commited on

(Trained with Unsloth)
c6b902a
verified

datatab commited on

Upload YugoGPT-Quantize-GGUF.Q4_K_M.gguf
201bced
verified

datatab commited on

Update README.md
c1acf39
verified

datatab commited on