Update README.md
Browse files
README.md
CHANGED
|
@@ -32,7 +32,7 @@ I was wondering how transformers work?<|im_end|>
|
|
| 32 |
<|im_start|>assistant
|
| 33 |
```
|
| 34 |
|
| 35 |
-
##
|
| 36 |
Please note that we tested this model with a 5.0bpw EXL2 quant. Results are not expected to be the same when going below this quanitzation. Thanks to our model quanters!
|
| 37 |
|
| 38 |
#### LlamaCPP (GGUF)
|
|
|
|
| 32 |
<|im_start|>assistant
|
| 33 |
```
|
| 34 |
|
| 35 |
+
## Quantizations
|
| 36 |
Please note that we tested this model with a 5.0bpw EXL2 quant. Results are not expected to be the same when going below this quanitzation. Thanks to our model quanters!
|
| 37 |
|
| 38 |
#### LlamaCPP (GGUF)
|