General discussion/quantization.

#2
by Lewdiculous - opened

Congrats on model performance!

I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix

I'll be uploading GGUF quants at:
https://huggingface.co/Lewdiculous/RoleBeagle-11B-GGUF-IQ-Imatrix

Awesome, thank you!

No problem, it was a request from @saishf . Keep up the good experimentation and happy cooking.

Sign up or log in to comment