wanghaofan
commited on
Commit
•
ca4695a
1
Parent(s):
441345d
Update README.md
Browse files
README.md
CHANGED
@@ -23,8 +23,8 @@ base_model: black-forest-labs/FLUX.1-dev
|
|
23 |
This repository contains an unified ControlNet for FLUX.1-dev model jointly released by researchers from [InstantX Team](https://huggingface.co/InstantX) and [Shakker Labs](https://huggingface.co/Shakker-Labs).
|
24 |
|
25 |
# Model Cards
|
26 |
-
- This checkpoint is a Pro version of [FLUX.1-dev-Controlnet-Union](https://huggingface.co/InstantX/FLUX.1-dev-Controlnet-Union).
|
27 |
-
- This model
|
28 |
- The recommended controlnet_conditioning_scale is 0.3-0.8.
|
29 |
- This model can be jointly used with other ControlNets.
|
30 |
|
@@ -88,6 +88,9 @@ controlnet_model_depth = './Shakker-Labs/FLUX.1-dev-Controlnet-Depth'
|
|
88 |
controlnet_depth = FluxControlNetModel.from_pretrained(controlnet_model_depth, torch_dtype=torch.bfloat16)
|
89 |
|
90 |
controlnet = FluxMultiControlNetModel([controlnet_union, controlnet_depth])
|
|
|
|
|
|
|
91 |
```
|
92 |
|
93 |
# Acknowledgements
|
|
|
23 |
This repository contains an unified ControlNet for FLUX.1-dev model jointly released by researchers from [InstantX Team](https://huggingface.co/InstantX) and [Shakker Labs](https://huggingface.co/Shakker-Labs).
|
24 |
|
25 |
# Model Cards
|
26 |
+
- This checkpoint is a Pro version of [FLUX.1-dev-Controlnet-Union](https://huggingface.co/InstantX/FLUX.1-dev-Controlnet-Union) trained with more steps and datasets.
|
27 |
+
- This model supports 7 control modes, including canny (0), tile (1), depth (2), blur (3), pose (4), gray (5), low quality (6).
|
28 |
- The recommended controlnet_conditioning_scale is 0.3-0.8.
|
29 |
- This model can be jointly used with other ControlNets.
|
30 |
|
|
|
88 |
controlnet_depth = FluxControlNetModel.from_pretrained(controlnet_model_depth, torch_dtype=torch.bfloat16)
|
89 |
|
90 |
controlnet = FluxMultiControlNetModel([controlnet_union, controlnet_depth])
|
91 |
+
|
92 |
+
# set mode to None for other ControlNets
|
93 |
+
control_mode=[2, None]
|
94 |
```
|
95 |
|
96 |
# Acknowledgements
|