mradermacher
commited on
Commit
•
12cc297
1
Parent(s):
4ee83ab
auto-patch README.md
Browse files
README.md
CHANGED
@@ -46,7 +46,6 @@ more details, including on how to concatenate multi-part files.
|
|
46 |
| [GGUF](https://huggingface.co/mradermacher/OrcaMaidXL-17B-32k-i1-GGUF/resolve/main/OrcaMaidXL-17B-32k.i1-Q5_K_M.gguf) | i1-Q5_K_M | 12.7 | |
|
47 |
| [GGUF](https://huggingface.co/mradermacher/OrcaMaidXL-17B-32k-i1-GGUF/resolve/main/OrcaMaidXL-17B-32k.i1-Q6_K.gguf) | i1-Q6_K | 14.6 | practically like static Q6_K |
|
48 |
|
49 |
-
|
50 |
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
51 |
types (lower is better):
|
52 |
|
|
|
46 |
| [GGUF](https://huggingface.co/mradermacher/OrcaMaidXL-17B-32k-i1-GGUF/resolve/main/OrcaMaidXL-17B-32k.i1-Q5_K_M.gguf) | i1-Q5_K_M | 12.7 | |
|
47 |
| [GGUF](https://huggingface.co/mradermacher/OrcaMaidXL-17B-32k-i1-GGUF/resolve/main/OrcaMaidXL-17B-32k.i1-Q6_K.gguf) | i1-Q6_K | 14.6 | practically like static Q6_K |
|
48 |
|
|
|
49 |
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
50 |
types (lower is better):
|
51 |
|