Why no q4_0_4_8?

#2
by ONTHEREDTEAM - opened

Cause i made this 6 months ago.

Q4_0_4_8 support was merged 3 months ago.

https://github.com/ggerganov/llama.cpp/commit/0f1a39f3439825acf7e3a1663566d410be152170

I can consider making some quants for this, but I would suggest a different attitude than "Sigh..." if you're going to ask for it.

Roger that, and sorry.

@ONTHEREDTEAM ARM quants are up

Thank you, and again apologies if I came off rudely. It was purely a moment where sometimes else told me this was "new". So the sigh wasn't meant to be directed towards you as much as the situation of being ill informed by another.
You do so much for the community and I appreciate you sir.

haha it's okay, i appreciate where you're coming from, and appreciate that not all emotions are well translated in text format :)

Enjoy!!

Sign up or log in to comment