this performs amazingly well even at 2bit Q2K

#1
by nisten - opened

I can't explain why entirely, but sometimes frankensteining really helps alleviate the degradation from going 2bit.

Randomly tried the q2k and it is surprisingly coherent at only 13 gigs size
Screenshot 2024-10-10 at 12.36.58 AM.png

and another try with the IQ3-M model, yeah, do not be afraid to just use the IQ-4xs of this model
Screenshot 2024-10-10 at 12.57.49 AM.png

indeed, impressive, although "sometimes", "helps", "alleviates" is not such a high bar :-)

Sign up or log in to comment