volrath50 commited on
Commit
026c252
1 Parent(s): ccca57d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -4
README.md CHANGED
@@ -10,9 +10,9 @@ tags:
10
  ---
11
  #fantasy-card-diffusion
12
 
13
- ####A comprehensive Stable Diffusion model for generating fantasy trading card style art, trained on all currently available Magic: the Gathering card art (~35k unique pieces of art). Has a strong understanding of MTG Artists, planes, sets, colors, card types, creature types and much more.
14
 
15
- ###For a guide on using the model, scroll down below
16
 
17
  ![Thumbnail](https://huggingface.co/volrath50/fantasy-card-diffusion/collage.jpg)
18
 
@@ -26,6 +26,19 @@ tags:
26
  - Does not, and cannot reproduce the actual card images - at best, you will get an image that looks like an alternate take by the same artist, using the same art description
27
  - Mix and match all of the above
28
 
 
 
 
 
 
 
 
 
 
 
 
 
 
29
  ## Training and dataset
30
  Training was done on a dataset consisting of cropped, 512x512 versions of the art for every MTG card, each of which was tagged using a custom python script, from data pulled from Scryfall. Training was done with the Dreambooth extension for Automatic1111's wonderful UI, to 130,000 steps.
31
 
@@ -52,7 +65,5 @@ This was intended to be a second test run on the full data set (the first did no
52
  -- Some artists use special characters in their name. I tried to take away all accents, but I missed at least one, Tom Wänerstrand, who is trained as Tom Wänerstrand, with the umlaut
53
  -- Greg Rutkowski: Not an issue, but the poster boy for AI art, Greg Rutkowski, is an MTG artist. He uses the Polish form of his name on MTG cards, Grzegorz Rutkowski, and that is what this model was trained with. So you'll get different results using "by Greg Rutkowski" vs "by Grzegorz Rutkowski"
54
 
55
- ## Using the Model
56
 
57
- The model was trained on standardized information pulled from Scryfall. It has no knowledge, specifically, of what is in the art, only what is on the card (beyond the artist) - but because the art tends to correlate with card information, it is pretty good at producing what you want, especially after a bit of playing with it. It doesn't need some secret prompt magic to get good images. Add words like "Ravnica" or "Jace" or "Basic Land - Island" to the prompt, and it will mostly do what you expect. Using weights is a good way to draw out specific tags. However, knowing how the training data works can help to get you what you want.
58
 
 
10
  ---
11
  #fantasy-card-diffusion
12
 
13
+ #### A comprehensive Stable Diffusion model for generating fantasy trading card style art, trained on all currently available Magic: the Gathering card art (~35k unique pieces of art). Has a strong understanding of MTG Artists, planes, sets, colors, card types, creature types and much more.
14
 
15
+ ### For a guide on using the model, scroll down below
16
 
17
  ![Thumbnail](https://huggingface.co/volrath50/fantasy-card-diffusion/collage.jpg)
18
 
 
26
  - Does not, and cannot reproduce the actual card images - at best, you will get an image that looks like an alternate take by the same artist, using the same art description
27
  - Mix and match all of the above
28
 
29
+ ## Using the Model
30
+
31
+ The model was trained on MtG card information, not art descriptions. This has the effect of preserving most non-MtG learning intact, allowing you to mix MtG card terms with an art description for great customization.
32
+
33
+ Each card was trained with card information pulled from Scryfall in the following format:
34
+
35
+ MTG card art, [Card Name], by [Artist], [year], [colors (words)], [colors (letters)], [card type], [rarity], [set name], [set code], [plane], [set type*], [watermark*], [mana cost], [security stamp*], [power/toughness*], [keywords*], [promo type*], [story spotlight*]
36
+
37
+ A few examples of actual card data in this format:
38
+ MTG card art, Ayula, Queen Among Bears, by Jesper Ejsing, 2019, Green, G, Legendary Creature - Bear, rare, Modern Horizons, mh1, draft_innovation, 1G, None, 2/2, Fight,
39
+ MTG card art, Force of Will, by Terese Nielsen, 1996, Blue, U, Instant, uncommon, Alliances, all, Dominaria, Terisiare, Ice Age, expansion, 3UU,
40
+
41
+
42
  ## Training and dataset
43
  Training was done on a dataset consisting of cropped, 512x512 versions of the art for every MTG card, each of which was tagged using a custom python script, from data pulled from Scryfall. Training was done with the Dreambooth extension for Automatic1111's wonderful UI, to 130,000 steps.
44
 
 
65
  -- Some artists use special characters in their name. I tried to take away all accents, but I missed at least one, Tom Wänerstrand, who is trained as Tom Wänerstrand, with the umlaut
66
  -- Greg Rutkowski: Not an issue, but the poster boy for AI art, Greg Rutkowski, is an MTG artist. He uses the Polish form of his name on MTG cards, Grzegorz Rutkowski, and that is what this model was trained with. So you'll get different results using "by Greg Rutkowski" vs "by Grzegorz Rutkowski"
67
 
 
68
 
 
69