knifeayumu/Lite-Cydonia-22B-v1.1-75-25-GGUF

Llamacpp Quantizations of knifeayumu/Lite-Cydonia-22B-v1.1-75-25

Using llama.cpp release b3837 for quantization.

Original model: knifeayumu/Lite-Cydonia-22B-v1.1-75-25

Quant Types:

Filename	Quant type	File Size
Lite-Cydonia-22B-v1.1-75-25-F16.gguf	F16	41.4GB
Lite-Cydonia-22B-v1.1-75-25-Q8_0.gguf	Q8_0	22.0GB
Lite-Cydonia-22B-v1.1-75-25-Q6_K.gguf	Q6_K	16.9GB
Lite-Cydonia-22B-v1.1-75-25-Q5_K_M.gguf	Q5_K_M	14.6GB
Lite-Cydonia-22B-v1.1-75-25-Q5_K_S.gguf	Q5_K_S	14.2GB
Lite-Cydonia-22B-v1.1-75-25-Q4_K_M.gguf	Q4_K_M	12.4GB
Lite-Cydonia-22B-v1.1-75-25-Q4_K_S.gguf	Q4_K_S	11.7GB
Lite-Cydonia-22B-v1.1-75-25-Q3_K_L.gguf	Q3_K_L	10.9GB
Lite-Cydonia-22B-v1.1-75-25-Q3_K_M.gguf	Q3_K_M	10.0GB
Lite-Cydonia-22B-v1.1-75-25-Q3_K_S.gguf	Q3_K_S	8.97GB
Lite-Cydonia-22B-v1.1-75-25-Q2_K.gguf	Q2_K	7.70GB