LayerDiffusion

/

layerdiffusion-v1

like 152

Is there a simple example of how to use this with SDXL and diffusers? Here is some starter code (that does not work) for img2img with turbo:

from diffusers import AutoPipelineForImage2Image
from diffusers.utils import load_image
import torch

SDXL_PATH = "./sdxl-turbo/"
LORA_PATH = "./layer_xl_transparent_attn.safetensors"
pipe = AutoPipelineForImage2Image.from_pretrained(SDXL_PATH, torch_dtype=torch.float16, variant="fp16")
pipe.load_lora_weights(LORA_PATH)
pipe.to("cuda")

init_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png").resize((512, 512))
prompt = "cat wizard, detailed, fantasy, cute, adorable, 8k"
image = pipe(prompt, image=init_image, num_inference_steps=2, strength=0.5, guidance_scale=0.0).images[0]