Text-to-Image
Diffusers
Safetensors
English
angelahzyuan commited on
Commit
c6c45f3
1 Parent(s): 6ec0661

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -2
README.md CHANGED
@@ -19,7 +19,7 @@ This model is a self-play fine-tuned diffusion model at iteration 3 from [runway
19
 
20
  ### Model Description
21
 
22
- - Model type: An diffusion model with unet fine-tuned, based on the strucure of stable diffusion 1.5
23
  - Language(s) (NLP): Primarily English
24
  - License: Apache-2.0
25
  - Finetuned from model: runwayml/stable-diffusion-v1-5
@@ -38,7 +38,29 @@ The following hyperparameters were used during training:
38
  - lr_warmup_steps: 200
39
  - num_training_steps: 500
40
 
41
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
  ## Citation
43
  ```
44
  @misc{yuan2024self,
 
19
 
20
  ### Model Description
21
 
22
+ - Model type: A diffusion model with unet fine-tuned, based on the structure of stable diffusion 1.5
23
  - Language(s) (NLP): Primarily English
24
  - License: Apache-2.0
25
  - Finetuned from model: runwayml/stable-diffusion-v1-5
 
38
  - lr_warmup_steps: 200
39
  - num_training_steps: 500
40
 
41
+ ### Usage
42
+ To use the model, you must first load the SD1.5 base model and then substitute its unet with our fine-tuned version.
43
+ ```python
44
+ from diffusers import StableDiffusionPipeline, UNet2DConditionModel
45
+ import torch
46
+
47
+ model_id = "runwayml/stable-diffusion-v1-5"
48
+ pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
49
+
50
+ unet_id = "UCLA-AGI/SPIN-Diffusion-iter3"
51
+ unet = UNet2DConditionModel.from_pretrained(unet_id, subfolder="unet", torch_dtype=torch.float16)
52
+ pipe.unet = unet
53
+
54
+ ###The rest of your generation code
55
+ ```
56
+
57
+ ### Evaluation Results on [Pick-a-pic test set](https://huggingface.co/datasets/yuvalkirstain/pickapic_v2/viewer/default/test_unique)
58
+ | Metric | Best of Five | Mean | Median
59
+ |-----------------------|---------------------------|--------|-------
60
+ | HPS | 0.28 | 0.27 | 0.27
61
+ | Aesthetic | 6.26 | 5.94 | 5.98
62
+ | Image Reward | 1.13 | 0.53 | 0.67
63
+ | Pickapic Score | 22.00 |21.36 | 21.46
64
  ## Citation
65
  ```
66
  @misc{yuan2024self,