Why only as GPTQ and not as GGUF as well ?
#1
by
Pumba2
- opened
as in the title, thanks
Pumba2
changed discussion title from
Why only for GPTQ and not for GGUF ?
to Why only for GPTQ and not for GGUF as well ?
Pumba2
changed discussion title from
Why only for GPTQ and not for GGUF as well ?
to Why only as GPTQ and not as GGUF as well ?
StableLM is not supported by GGUF yet. https://github.com/ggerganov/llama.cpp/pull/3586
