Hugging Face's logo

TheNetherWatcher
/
kanji-diffusion-xl

Text-to-Image
Diffusers
TensorBoard
stable-diffusion-xl
stable-diffusion-xl-diffusers
diffusers-training
lora
Model card Files Metrics Community
TheNetherWatcher commited on
Commit
9d3f11d
•
1 Parent(s): 3698880

End of training

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +48 -0
  2. checkpoint-1000/optimizer.bin +3 -0
  3. checkpoint-1000/pytorch_lora_weights.safetensors +3 -0
  4. checkpoint-1000/random_states_0.pkl +3 -0
  5. checkpoint-1000/scheduler.bin +3 -0
  6. checkpoint-1500/optimizer.bin +3 -0
  7. checkpoint-1500/pytorch_lora_weights.safetensors +3 -0
  8. checkpoint-1500/random_states_0.pkl +3 -0
  9. checkpoint-1500/scheduler.bin +3 -0
  10. checkpoint-2000/optimizer.bin +3 -0
  11. checkpoint-2000/pytorch_lora_weights.safetensors +3 -0
  12. checkpoint-2000/random_states_0.pkl +3 -0
  13. checkpoint-2000/scheduler.bin +3 -0
  14. checkpoint-2500/optimizer.bin +3 -0
  15. checkpoint-2500/pytorch_lora_weights.safetensors +3 -0
  16. checkpoint-2500/random_states_0.pkl +3 -0
  17. checkpoint-2500/scheduler.bin +3 -0
  18. checkpoint-3000/optimizer.bin +3 -0
  19. checkpoint-3000/pytorch_lora_weights.safetensors +3 -0
  20. checkpoint-3000/random_states_0.pkl +3 -0
  21. checkpoint-3000/scheduler.bin +3 -0
  22. checkpoint-3500/optimizer.bin +3 -0
  23. checkpoint-3500/pytorch_lora_weights.safetensors +3 -0
  24. checkpoint-3500/random_states_0.pkl +3 -0
  25. checkpoint-3500/scheduler.bin +3 -0
  26. checkpoint-4000/optimizer.bin +3 -0
  27. checkpoint-4000/pytorch_lora_weights.safetensors +3 -0
  28. checkpoint-4000/random_states_0.pkl +3 -0
  29. checkpoint-4000/scheduler.bin +3 -0
  30. checkpoint-4500/optimizer.bin +3 -0
  31. checkpoint-4500/pytorch_lora_weights.safetensors +3 -0
  32. checkpoint-4500/random_states_0.pkl +3 -0
  33. checkpoint-4500/scheduler.bin +3 -0
  34. checkpoint-500/optimizer.bin +3 -0
  35. checkpoint-500/pytorch_lora_weights.safetensors +3 -0
  36. checkpoint-500/random_states_0.pkl +3 -0
  37. checkpoint-500/scheduler.bin +3 -0
  38. checkpoint-5000/optimizer.bin +3 -0
  39. checkpoint-5000/pytorch_lora_weights.safetensors +3 -0
  40. checkpoint-5000/random_states_0.pkl +3 -0
  41. checkpoint-5000/scheduler.bin +3 -0
  42. image_0.png +0 -0
  43. image_1.png +0 -0
  44. image_2.png +0 -0
  45. image_3.png +0 -0
  46. logs/text2image-fine-tune/1726437891.8286443/events.out.tfevents.1726437891.192-9-139-209.3924325.1 +3 -0
  47. logs/text2image-fine-tune/1726437891.842946/hparams.yml +50 -0
  48. logs/text2image-fine-tune/1726437936.1835158/events.out.tfevents.1726437936.192-9-139-209.3924496.1 +3 -0
  49. logs/text2image-fine-tune/1726437936.1975772/hparams.yml +54 -0
  50. logs/text2image-fine-tune/events.out.tfevents.1726437891.192-9-139-209.3924325.0 +3 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
3
+ library_name: diffusers
4
+ license: creativeml-openrail-m
5
+ tags:
6
+ - stable-diffusion-xl
7
+ - stable-diffusion-xl-diffusers
8
+ - text-to-image
9
+ - diffusers
10
+ - diffusers-training
11
+ - lora
12
+ inference: true
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+
19
+ # LoRA text2image fine-tuning - TheNetherWatcher/kanji-diffusion-xl
20
+
21
+ These are LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0. The weights were fine-tuned on the yashvoladoddi37/kanjienglish dataset. You can find some example images in the following.
22
+
23
+ ![img_0](./image_0.png)
24
+ ![img_1](./image_1.png)
25
+ ![img_2](./image_2.png)
26
+ ![img_3](./image_3.png)
27
+
28
+
29
+ LoRA for the text encoder was enabled: False.
30
+
31
+ Special VAE used for training: None.
32
+
33
+
34
+ ## Intended uses & limitations
35
+
36
+ #### How to use
37
+
38
+ ```python
39
+ # TODO: add an example code snippet for running this diffusion pipeline
40
+ ```
41
+
42
+ #### Limitations and bias
43
+
44
+ [TODO: provide examples of latent issues and potential remediations]
45
+
46
+ ## Training details
47
+
48
+ [TODO: describe the data used to train the model]
checkpoint-1000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adc37b88ae869e7a9f06c3659e702c62986b8c08bc46c73328c51bf2bd83a04b
3
+ size 24168626
checkpoint-1000/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7ea0d3ea49788dca5c920322ce0802ba8a9a16905c80f01a491782634678740
3
+ size 11778368
checkpoint-1000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3052cfb1168a0e8693ed4a3e620ba56851123a511d658ccb21809f21a4fcbb5
3
+ size 14344
checkpoint-1000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1ef945fb67548939f1340070803ddc6f91925dd6d43f8c15ba25d113f03c5ed
3
+ size 1000
checkpoint-1500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0ecf5a7f7466169f11aefd1c4dc74b35d2293535ba6eb65c31bc8a872afd24c
3
+ size 24168626
checkpoint-1500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec0e761196b42850acc337260ea0999e977195d727c1d03135258b98afcec6ae
3
+ size 11778368
checkpoint-1500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71b9975309282b072dcfb9c2a3431e341cf5ae65e96190f8e07b7c8c1c54af38
3
+ size 14344
checkpoint-1500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48bc4e7f165d13c3a118fbfce412755c802dfee9a7a91ae2a24ef2a694c18483
3
+ size 1000
checkpoint-2000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8773e38692d68812562d15d36fa228c91a1677f34fee73a4426b2e90e7781ca3
3
+ size 24168626
checkpoint-2000/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e9209bebc8945c2be671996ffc899652495602a90ebc831963c50b146d97d60
3
+ size 11778368
checkpoint-2000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a88170b32e3a3e452939c389595fa0fb3d03194b1a9df8f8f01d4a7f5052b0ec
3
+ size 14408
checkpoint-2000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a14cab18e3cf6bf4020ba19261b57bd47f02eb286b8412b0d80f0e1c055663a
3
+ size 1000
checkpoint-2500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4955acbc66fbde581c0f3b03ec9e787bb14cf40fc83c10fa3ff79c603f77466b
3
+ size 24168626
checkpoint-2500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:26d040f1361e72661e96873598096807de106ebc950888b2ef5b70d01860a734
3
+ size 11778368
checkpoint-2500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da969efa462cca8617e1465318119273013ad22d3a458310e367d836f74a38ac
3
+ size 14408
checkpoint-2500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7806de3d060880702efffb6e8dfae4e935b646ac22a298bfd34612aa6bd7e66a
3
+ size 1000
checkpoint-3000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fa923a9a37b1f5bf8957747fe7456fa5ce2297e69ee88e170c9fe8f67e88358
3
+ size 24168626
checkpoint-3000/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ff9dab6231351c64bf41122fb11e0ae462777c4fc0e648d92bb64dead330ecf
3
+ size 11778368
checkpoint-3000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8e6423b3131703a74735409b7768f828ff0c04b7a56fcd31b58f9085628f82b
3
+ size 14344
checkpoint-3000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2833302ff3e9f19a529d4b4c25d428a2569db9e059211a2009fd20f9a2843aba
3
+ size 1000
checkpoint-3500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0c70fef50aa676b0d693eda252cdcbcb83e7394fea6fbdfae79cedc1e960551
3
+ size 24168626
checkpoint-3500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37b61cee3a3c45d1a0daa0af5a28ea98452bce50d3d43d4ccd41a030137a17a2
3
+ size 11778368
checkpoint-3500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a82c31c8aa39e9c54e063691050f2e6ad2a3dac1f582acedf5f1c650384675b
3
+ size 14344
checkpoint-3500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54466fd70988c268b02aa0449cb2f657a41c168d7d1981cc9e3b9f130eac63fe
3
+ size 1000
checkpoint-4000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c24d5d96007fa76f30c9f13887b7518c7a0125a0f03ad30330f2ae3b4e1f9671
3
+ size 24168626
checkpoint-4000/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d1f8b7a7c973a84aeb5c41caab77bf80e5dc0630b93620d525af338e2d8c7c8
3
+ size 11778368
checkpoint-4000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0e76020b46bac8d61f82c3ac6652444adbc733f589c18a3ed8dcf959d0d41b6
3
+ size 14344
checkpoint-4000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2310f63637c6cf3848fe289e21d70c2e6b3542292bf5c5d51e6dab0afab209f7
3
+ size 1000
checkpoint-4500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac51c3825a05f1f9b8c0de6bbe4a2df6f93118d92abb8e13fd7f789c320343d7
3
+ size 24168626
checkpoint-4500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0b8cedc080540ccf53e5b0837f297e5d0f1208b58a245660e5d2305d6e21aca
3
+ size 11778368
checkpoint-4500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:581d729720938e2d97f1caf48fac4a7b85f66cb9b32055aea7d6feca5e376b46
3
+ size 14344
checkpoint-4500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:843072ee388d5629a932371b8265f451662d8a1ce285e2ddffd5bb68c88314f6
3
+ size 1000
checkpoint-500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18e5689c38fd236cd662ef089a04004adffa4ad085bc4b15c2a33906ef5a1c97
3
+ size 24168626
checkpoint-500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d0428f7089f34db4aab646ac03d5cde28f544a01fb7b579abf205c993888ef6
3
+ size 11778368
checkpoint-500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0cfb806d27f1589ad9ca26f0e8de6ae6e373d077911594e942803f885c7e6f33
3
+ size 14344
checkpoint-500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cf34ac8dd2addc454aeb1ee4eaba3267c2841857e117be40ac2ed02cf581c9c
3
+ size 1000
checkpoint-5000/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e32d642142ed4491e113d7d639a10601e011d6b902a5533c5ebbc00f433efbd
3
+ size 24168626
checkpoint-5000/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99d6eb2ee9ee1a5ff2f581f002d87aa79cda7a95ec9e09589d16b295bdf09a81
3
+ size 11778368
checkpoint-5000/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d5eef19cf2d77ee7740ba50142c16137997f1d315881a9b01f977acc08c459e
3
+ size 14344
checkpoint-5000/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b2734d36d08357236113a0d0e82c9a606fbb22a775c8bb9049c19d997ef37430
3
+ size 1000
image_0.png ADDED
image_1.png ADDED
image_2.png ADDED
image_3.png ADDED
logs/text2image-fine-tune/1726437891.8286443/events.out.tfevents.1726437891.192-9-139-209.3924325.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:034929ace0c6d01c0439c2270508380749062a85fff4acd4c32f565ad461d00e
3
+ size 2299
logs/text2image-fine-tune/1726437891.842946/hparams.yml ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 0
12
+ dataset_config_name: null
13
+ dataset_name: yashvoladoddi37/kanjienglish
14
+ enable_xformers_memory_efficient_attention: false
15
+ gradient_accumulation_steps: 1
16
+ gradient_checkpointing: false
17
+ hub_model_id: null
18
+ hub_token: null
19
+ image_column: image
20
+ learning_rate: 0.0001
21
+ local_rank: -1
22
+ logging_dir: logs
23
+ lr_scheduler: constant
24
+ lr_warmup_steps: 0
25
+ max_grad_norm: 1.0
26
+ max_train_samples: null
27
+ max_train_steps: 5082
28
+ mixed_precision: bf16
29
+ noise_offset: 0
30
+ num_train_epochs: 1
31
+ num_validation_images: 4
32
+ output_dir: kanji-diffusion-xl
33
+ prediction_type: null
34
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
35
+ push_to_hub: true
36
+ random_flip: true
37
+ rank: 4
38
+ report_to: tensorboard
39
+ resolution: 512
40
+ resume_from_checkpoint: null
41
+ revision: null
42
+ scale_lr: false
43
+ seed: 42
44
+ snr_gamma: null
45
+ train_batch_size: 1
46
+ train_data_dir: null
47
+ use_8bit_adam: false
48
+ validation_epochs: 1
49
+ validation_prompt: A kanji meaning Elon Musk
50
+ variant: null
logs/text2image-fine-tune/1726437936.1835158/events.out.tfevents.1726437936.192-9-139-209.3924496.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05d4580179bd3440bdae61d47b2547309f108c323f137506e5a7d6aacfbc25f6
3
+ size 2470
logs/text2image-fine-tune/1726437936.1975772/hparams.yml ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 0
12
+ dataset_config_name: null
13
+ dataset_name: yashvoladoddi37/kanjienglish
14
+ debug_loss: false
15
+ enable_npu_flash_attention: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ gradient_accumulation_steps: 1
18
+ gradient_checkpointing: false
19
+ hub_model_id: null
20
+ hub_token: null
21
+ image_column: image
22
+ learning_rate: 0.0001
23
+ local_rank: -1
24
+ logging_dir: logs
25
+ lr_scheduler: constant
26
+ lr_warmup_steps: 0
27
+ max_grad_norm: 1.0
28
+ max_train_samples: null
29
+ max_train_steps: 5082
30
+ mixed_precision: bf16
31
+ noise_offset: 0
32
+ num_train_epochs: 1
33
+ num_validation_images: 4
34
+ output_dir: kanji-diffusion-xl
35
+ prediction_type: null
36
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
37
+ pretrained_vae_model_name_or_path: null
38
+ push_to_hub: true
39
+ random_flip: true
40
+ rank: 4
41
+ report_to: tensorboard
42
+ resolution: 512
43
+ resume_from_checkpoint: null
44
+ revision: null
45
+ scale_lr: false
46
+ seed: 42
47
+ snr_gamma: null
48
+ train_batch_size: 1
49
+ train_data_dir: null
50
+ train_text_encoder: false
51
+ use_8bit_adam: false
52
+ validation_epochs: 1
53
+ validation_prompt: A kanji meaning Elon Musk
54
+ variant: null
logs/text2image-fine-tune/events.out.tfevents.1726437891.192-9-139-209.3924325.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd2a7963839b726092e39cb43a32394ce04eaac6c38002e6e567ff9819269297
3
+ size 88