Kooten
/

DaringMaid-20B-V1.1-3.5bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Kooten commited on Jan 31

Commit

3516331

•

1 Parent(s): 7cc0c33

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -14,7 +14,7 @@ This is an updated version of [DaringMaid-20B](https://huggingface.co/Kooten/Dar
 I used v0.3 since it was the last to use Alpaca as to not break anything.
 # Quants
-EXL2: [6bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-6bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-3bpw-exl2)
 [GGUF](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF): [Q3_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q3_K_M.gguf) - [Q4_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q4_K_M.gguf) - [Q5_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q5_K_M.gguf) - [Q6_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q6_K.gguf)

 I used v0.3 since it was the last to use Alpaca as to not break anything.
 # Quants
+EXL2: [6bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-4bpw-exl2), [3.5bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-3bpw-exl2)
 [GGUF](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF): [Q3_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q3_K_M.gguf) - [Q4_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q4_K_M.gguf) - [Q5_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q5_K_M.gguf) - [Q6_K_M](https://huggingface.co/Kooten/DaringMaid-20B-V1.1-GGUF/blob/main/DaringMaid-20B-V1.1-Q6_K.gguf)