Method for this producing this model
#1
by
blobpenguin
- opened
Hi
@mgoin
,
How was this model produced? In practice I find that it is the best performing GPTQ quant for llama3-70B.
It would be wonderful to replicate the method for llama3.1-70B.
Cheers,
Adi