Isn't it odd that these models compress pretty well?
#1
by
HenkPoley
- opened
Shouldn't that mean even denser representation is possible?
GGML (and GPTQ) are doing lower precision conversion (there is data loss).
Compression implies the original is preserved as is which is not the case here.
Oh, I mean the .zips
Ah wait, I see. They are not small .zip files. They are .zip + .z01 files that need to be added up.
HenkPoley
changed discussion status to
closed