Hugging Face's logo

waldie
/
Athena-v4-8bpw-h8-exl2

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1

Hello

#1
by CulturedMan - opened
Discussion
CulturedMan

Any plans on uploading other quants of this one? I can't hit 4k with anything more than 3 bpw on my potato comp.

waldie
 Owner

i'll run a 3bpw for you

waldie
 Owner

https://huggingface.co/waldie/Athena-v4-3bpw-h6-exl2

CulturedMan

Thanks!

Sign up or log in to comment