Edit model card

Dream Dis Pix XL

Prompt
Shrek playing with olaf in a frozen field DreamDisPix style
Prompt
The girl from the incredibles shooting a laser gun DreamDisPix style
Prompt
The girl with a pearl earring DreamDisPix style
Prompt
Snoop Dogg DreamDisPix style
Prompt
A mighty dragon at the dentist DreamDisPix style
Prompt
A cute dragon playing with Eevee DreamDisPix style
Prompt
Zombie Cinderella has rissen from the dead DreamDisPix style
Prompt
Santa riding a might dragon DreamDisPix style
Prompt
Pocahontas riding a Zebra DreamDisPix style
Prompt
American gothic DreamDisPix style

(CivitAI)

Model description

A (kinda failed) attempt to train an SDXL LoRA model upon on a mixed style dataset of images from Dreamworks, Disney and Pixar. I have uploaded this Blip2-Captioned Dataset to Huggingface.

I usually prefer to train in LoRA ranks 4-16 because so far it always seemed to be enough and provided a reasonably small checkpoint but in this case, I only started getting results when I went for Rank-32, even tried 24 and it was not enough.

My conclusion is that it should have probably been trained as several different lower ranked LoRAs each for the specific visual sub-style and it would have probably looked way better for each.

Trigger words

You should use DreamDisPix style to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('Norod78/dream-dis-pix-xl', weight_name='SDXL-DreamDisPix-Lora-r32.safetensors')
image = pipeline('American gothic  DreamDisPix style  ').images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers

Downloads last month
29
Inference API
Examples

Model tree for Norod78/dream-dis-pix-xl

Adapter
(4847)
this model

Dataset used to train Norod78/dream-dis-pix-xl

Spaces using Norod78/dream-dis-pix-xl 3

Collection including Norod78/dream-dis-pix-xl