Isn't it odd that these models compress pretty well?

#1
by HenkPoley - opened

Shouldn't that mean even denser representation is possible?

GGML (and GPTQ) are doing lower precision conversion (there is data loss).

Compression implies the original is preserved as is which is not the case here.

Oh, I mean the .zips

Ah wait, I see. They are not small .zip files. They are .zip + .z01 files that need to be added up.

HenkPoley changed discussion status to closed

Sign up or log in to comment