GGUF version please

#2
by HR1777 - opened

Is it possible that you kindly release the GGUF version of this model too? Q8-0 please.

Sure. I’ll work on quantizing this tonight.

Locutusque changed discussion status to closed

Sign up or log in to comment