File size: 1,637 Bytes
93bd424
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
fa52b26
 
 
 
448b9ae
 
 
93bd424
 
 
 
 
 
 
 
448b9ae
 
 
 
 
 
 
 
 
93bd424
 
 
448b9ae
93bd424
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
---
license: creativeml-openrail-m
library_name: diffusers
tags:
- stable-diffusion
- stable-diffusion-diffusers
- text-to-image
- diffusers
- diffusers-training
- lora
base_model: runwayml/stable-diffusion-v1-5
inference: true
---

<!-- This model card has been generated automatically according to the information the training script had access to. You
should probably proofread and complete it, then remove this comment. -->


# LoRA text2image fine-tuning - iamkaikai/MATISSEE-LORA
These are LoRA adaption weights for runwayml/stable-diffusion-v1-5. The weights were fine-tuned on the iamkaikai/MATISSEE-ART dataset. You can find some example images in the following. 

![img_0](./image_0.jpg)
![img_1](./image_1.jpg)
![img_2](./image_2.jpg)
![img_3](./image_3.jpg)
![img_4](./image_0.png)
![img_5](./image_13.png)
![img_6](./image_17.png)



## Intended uses & limitations

#### How to use

```python
from diffusers import AutoPipelineForText2Image
import torch

pipeline = AutoPipelineForText2Image.from_pretrained("runwayml/stable-diffusion-v1-5", torch_dtype=torch.float16, safety_checker=None).to("cuda")
pipeline.load_lora_weights("iamkaikai/MATISSEE-LORA", weight_name="pytorch_lora_weights.safetensors")
prompt = "MATISSEE-ART, brown, beige, coral, gray, orange red, violet, black, teal"
for i in range(20):
    image = pipeline(prompt, num_inference_steps=20).images[0]
    image.save(f"./image_{str(i)}.png")
```

#### Limitations and bias
For some reason, this LORA model will often trigger the NSFW filter. Make sure you turn it off in the pipeline.

## Training details

[TODO: describe the data used to train the model]