Difference between flux1-dev-Q4_0 flux1-dev-Q4_1
#7
by
vcringer
- opened
Hello,
I see too models landed today, namely flux1-dev-Q4_1.gguf, and flux1-dev-Q5_1.gguf. What are these models? And what is the difference between flux1-dev-Q4_0.gguf and flux1-dev-Q4_1.gguf? The Q5 variants?
Thanks
They're just different quantization types that I added later. See this old chart for reference
city96
changed discussion status to
closed
which are recommended to use? (0 vs 1)
1 is slightly better quality than 0 but also larger in terms of size. Pick whichever fits your VRAM without having to use CPU lowvram offloading.