--- license: other license_name: flux-1-dev-non-commercial-license license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md --- GGUF quants of https://huggingface.co/Shakker-Labs/AWPortrait-FL/ made using instructions from https://github.com/city96/ComfyUI-GGUF/ . This is my first time quantizing anything. I find the Q8_0 version of Flux Dev fp16 to be the best one to use, so I wanted to be able to have Q8_0 quants of finetuned models as they come out. The K quants do not work with Forge as of 2024/09/06. I used a fork (https://github.com/mhnakif/ComfyUI-GGUF/) to make Q4_0, Q5_0, Q8_0 and F16, which do work in Forge.