Would it be possible to have an 8bit gguf?
#1
by
PurityWolf
- opened
As title; Would it be possible to have an 8bit gguf. This model is of interest and 70b-8bit fits nice on 2x48GB cards. Would greatly appreciate it.
sorry. I forgot, I'll upload it soon
done.