Is there a gptq format model, thank you
#2
by
hugingfaceg
- opened
The model is too large, is there a quant model like gptq format
Thank you for your attention. We will provide a quantified version later.
Looks interesting, I'll do GGUF, GPTQ, AWQ quants today