These are GGUF quants for the following model:
https://huggingface.co/FallenMerick/Iced-Lemon-Cookie-7B
4-bit
6-bit
8-bit
16-bit
Base model