lodrick-the-lafted
commited on
Commit
•
4f64b3d
1
Parent(s):
ab56f2c
Update README.md
Browse files
README.md
CHANGED
@@ -124,13 +124,15 @@ In our testing, this model seems like a storyteller, as might be expected, but t
|
|
124 |
<br/>
|
125 |
|
126 |
GGUF quants available at: [alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main). <br/>
|
|
|
127 |
|
128 |
Some exl2 quants were made by llmixer too:
|
129 |
- [2.5bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2)
|
130 |
- [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
|
131 |
- [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
|
132 |
|
133 |
-
|
|
|
134 |
|
135 |
<br/>
|
136 |
<br/>
|
|
|
124 |
<br/>
|
125 |
|
126 |
GGUF quants available at: [alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF](https://huggingface.co/alchemonaut/QuartetAnemoi-70B-t0.0001-GGUF/tree/main). <br/>
|
127 |
+
Nexesenex made some [GGUF iMatrix quants](https://huggingface.co/Nexesenex/alchemonaut_QuartetAnemoi-70B-iMat.GGUF).
|
128 |
|
129 |
Some exl2 quants were made by llmixer too:
|
130 |
- [2.5bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-2.5bpw-h6-exl2)
|
131 |
- [4.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-4bpw-h6-exl2)
|
132 |
- [6.0bpw](https://huggingface.co/llmixer/QuartetAnemoi-70B-t0.0001-6.0bpw-h6-exl2)
|
133 |
|
134 |
+
|
135 |
+
[AWQ quant by tachyphylaxis](https://huggingface.co/tachyphylaxis/QuartetAnemoi-70B-t0.0001-AWQ)
|
136 |
|
137 |
<br/>
|
138 |
<br/>
|