General discussion/quantization.
#2
by
Lewdiculous
- opened
Congrats on model performance!
I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix
I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix
Awesome, thank you!