Hugging Face's logo

Aeala
/
GPT4-x-AlpacaDente2-30b

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
5
Aeala commited on
Commit
5d292ba
•
1 Parent(s): 322c811

Add 4bit benchmarks.

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -11,4 +11,12 @@ ChanSung's [Alpaca-LoRA-30B-elina](https://huggingface.co/LLMs/Alpaca-LoRA-30B-e
11
 
12
  **C4:** 7.05504846572876
13
 
14
- ~ Thanks to askmyteapot for performing this benchmark!
 
 
 
 
 
 
 
 
 
11
 
12
  **C4:** 7.05504846572876
13
 
14
+ [4bit](https://huggingface.co/Aeala/GPT4-x-AlpacaDente2-30b/blob/main/4bit.safetensors):
15
+
16
+ **Wikitext2:** 5.016242980957031
17
+
18
+ **PTB:** 25.576189041137695
19
+
20
+ **C4:** 7.332120418548584
21
+
22
+ ~ Thanks to [askmyteapot](https://huggingface.co/askmyteapot) for performing these benchmarks!