Sharing the load with CPU or Shared GPU similar to Forge

#2
by Thangamani - opened

Very Good Effort - I appreciate.

Please alter the coding to share the image generation load between GPU, CPU and Shared GPU. (Reference: https://github.com/lllyasviel/stable-diffusion-webui-forge)

It will be useful for the users with low VRAM

I appreciate your efforts - But unable to use your SimpleSDXL2, I have only 8GB GPU

Owner

SimpleSDXL2 already supports the Flux models of bnb-nf4, bnb-nf4-v2, and gguf Qx series. Some users have successfully run Flux1 in the 4G VRAM environment. It can run on your 8GB GPU without any problems.

Sign up or log in to comment