README.md CHANGED
@@ -1,15 +1,14 @@
1
  ---
2
  license: apache-2.0
3
  tags:
 
4
  - Text-to-Image
5
  - ControlNet
6
  - Diffusers
7
  - Stable Diffusion
8
- pipeline_tag: text-to-image
9
  ---
10
 
11
  # **ControlNet++: All-in-one ControlNet for image generations and editing!**
12
- ## **ProMax Model has released!! 12 control + 5 advanced editing, just try it!!!**
13
  ![images_display](./images/masonry.webp)
14
 
15
  ## Network Arichitecture
@@ -37,55 +36,6 @@ Inference scripts and more details can found: https://github.com/xinsir6/Control
37
 
38
  **If you find it useful, please give me a star, thank you very much**
39
 
40
- **SDXL ProMax version has been released!!!,Enjoy it!!!**
41
-
42
- **I am sorry that because of the project's revenue and expenditure are difficult to balance, the GPU resources are assigned to other projects that are more likely to be profitable, the SD3 trainging is stopped until I find enough GPU supprt, I will try my best to find GPUs to continue training. If this brings you inconvenience, I sincerely apologize for that. I want to thank everyone who likes this project, your support is what keeps me going**
43
-
44
- Note: we put the promax model with a promax suffix in the same [huggingface model repo](https://huggingface.co/xinsir/controlnet-union-sdxl-1.0), detailed instructions will be added later.
45
- ## Advanced editing features in Promax Model
46
- ### Tile Deblur
47
- ![blur0](./images/100000_tile_blur_concat.webp)
48
- ![blur1](./images/100001_tile_blur_concat.webp)
49
- ![blur2](./images/100002_tile_blur_concat.webp)
50
- ![blur3](./images/100003_tile_blur_concat.webp)
51
- ![blur4](./images/100004_tile_blur_concat.webp)
52
- ![blur5](./images/100005_tile_blur_concat.webp)
53
- ### Tile variation
54
- ![var0](./images/100006_tile_var_concat.webp)
55
- ![var1](./images/100007_tile_var_concat.webp)
56
- ![var2](./images/100008_tile_var_concat.webp)
57
- ![var3](./images/100009_tile_var_concat.webp)
58
- ![var4](./images/100010_tile_var_concat.webp)
59
- ![var5](./images/100011_tile_var_concat.webp)
60
-
61
- ### Tile Super Resolution
62
- Following example show from 1M resolution --> 9M resolution
63
- <div style="display: flex; justify-content: space-between;">
64
- <img src="./images/tile_super1.webp" alt="Image 1" style="width: 49%; margin: 1%;">
65
- <img src="./images/tile_super1_9upscale.webp" alt="Image 2" style="width: 49%; margin: 1%;">
66
- </div>
67
-
68
- <div style="display: flex; justify-content: space-between;">
69
- <img src="./images/tile_super2.webp" alt="Image 1" style="width: 49%; margin: 1%;">
70
- <img src="./images/tile_super2_9upscale.webp" alt="Image 2" style="width: 49%; margin: 1%;">
71
- </div>
72
-
73
- ### Image Inpainting
74
- ![inp0](./images/100018_inpainting_concat.webp)
75
- ![inp1](./images/100019_inpainting_concat.webp)
76
- ![inp2](./images/100020_inpainting_concat.webp)
77
- ![inp3](./images/100021_inpainting_concat.webp)
78
- ![inp4](./images/100022_inpainting_concat.webp)
79
- ![inp5](./images/100023_inpainting_concat.webp)
80
-
81
- ### Image Outpainting
82
- ![oup0](./images/100012_outpainting_concat.webp)
83
- ![oup1](./images/100013_outpainting_concat.webp)
84
- ![oup2](./images/100014_outpainting_concat.webp)
85
- ![oup3](./images/100015_outpainting_concat.webp)
86
- ![oup4](./images/100016_outpainting_concat.webp)
87
- ![oup5](./images/100017_outpainting_concat.webp)
88
-
89
 
90
  ## Visual Examples
91
  ### Openpose
 
1
  ---
2
  license: apache-2.0
3
  tags:
4
+ - SDXL
5
  - Text-to-Image
6
  - ControlNet
7
  - Diffusers
8
  - Stable Diffusion
 
9
  ---
10
 
11
  # **ControlNet++: All-in-one ControlNet for image generations and editing!**
 
12
  ![images_display](./images/masonry.webp)
13
 
14
  ## Network Arichitecture
 
36
 
37
  **If you find it useful, please give me a star, thank you very much**
38
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
39
 
40
  ## Visual Examples
41
  ### Openpose
config_promax.json DELETED
@@ -1,57 +0,0 @@
1
- {
2
- "_class_name": "ControlNetModel",
3
- "_diffusers_version": "0.20.0.dev0",
4
- "act_fn": "silu",
5
- "addition_embed_type": "text_time",
6
- "addition_embed_type_num_heads": 64,
7
- "addition_time_embed_dim": 256,
8
- "attention_head_dim": [
9
- 5,
10
- 10,
11
- 20
12
- ],
13
- "block_out_channels": [
14
- 320,
15
- 640,
16
- 1280
17
- ],
18
- "class_embed_type": null,
19
- "conditioning_channels": 3,
20
- "conditioning_embedding_out_channels": [
21
- 16,
22
- 32,
23
- 96,
24
- 256
25
- ],
26
- "controlnet_conditioning_channel_order": "rgb",
27
- "cross_attention_dim": 2048,
28
- "down_block_types": [
29
- "DownBlock2D",
30
- "CrossAttnDownBlock2D",
31
- "CrossAttnDownBlock2D"
32
- ],
33
- "downsample_padding": 1,
34
- "encoder_hid_dim": null,
35
- "encoder_hid_dim_type": null,
36
- "flip_sin_to_cos": true,
37
- "freq_shift": 0,
38
- "global_pool_conditions": false,
39
- "in_channels": 4,
40
- "layers_per_block": 2,
41
- "mid_block_scale_factor": 1,
42
- "norm_eps": 1e-05,
43
- "norm_num_groups": 32,
44
- "num_attention_heads": null,
45
- "num_class_embeds": null,
46
- "only_cross_attention": false,
47
- "projection_class_embeddings_input_dim": 2816,
48
- "resnet_time_scale_shift": "default",
49
- "transformer_layers_per_block": [
50
- 1,
51
- 2,
52
- 10
53
- ],
54
- "upcast_attention": null,
55
- "use_linear_projection": true,
56
- "num_control_type": 8
57
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
diffusion_pytorch_model_promax.safetensors DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:9fae2e50cb431bfcbe05822b59ec2228df545ef27f711dea8949e9f4ed9f7cdc
3
- size 2513342408
 
 
 
 
images/100000_tile_blur_concat.webp DELETED
Binary file (297 kB)
 
images/100001_tile_blur_concat.webp DELETED
Binary file (396 kB)
 
images/100002_tile_blur_concat.webp DELETED
Binary file (312 kB)
 
images/100003_tile_blur_concat.webp DELETED
Binary file (524 kB)
 
images/100004_tile_blur_concat.webp DELETED
Binary file (179 kB)
 
images/100005_tile_blur_concat.webp DELETED
Binary file (469 kB)
 
images/100006_tile_var_concat.webp DELETED
Binary file (234 kB)
 
images/100007_tile_var_concat.webp DELETED
Binary file (315 kB)
 
images/100008_tile_var_concat.webp DELETED
Binary file (601 kB)
 
images/100009_tile_var_concat.webp DELETED
Binary file (486 kB)
 
images/100010_tile_var_concat.webp DELETED
Binary file (932 kB)
 
images/100011_tile_var_concat.webp DELETED
Binary file (204 kB)
 
images/100012_outpainting_concat.webp DELETED
Binary file (629 kB)
 
images/100013_outpainting_concat.webp DELETED
Binary file (230 kB)
 
images/100014_outpainting_concat.webp DELETED
Binary file (276 kB)
 
images/100015_outpainting_concat.webp DELETED
Binary file (461 kB)
 
images/100016_outpainting_concat.webp DELETED
Binary file (201 kB)
 
images/100017_outpainting_concat.webp DELETED
Binary file (136 kB)
 
images/100018_inpainting_concat.webp DELETED
Binary file (120 kB)
 
images/100019_inpainting_concat.webp DELETED
Binary file (231 kB)
 
images/100020_inpainting_concat.webp DELETED
Binary file (520 kB)
 
images/100021_inpainting_concat.webp DELETED
Binary file (187 kB)
 
images/100022_inpainting_concat.webp DELETED
Binary file (138 kB)
 
images/100023_inpainting_concat.webp DELETED
Binary file (305 kB)
 
images/tile_super1.webp DELETED
Binary file (115 kB)
 
images/tile_super1_9upscale.webp DELETED
Binary file (898 kB)
 
images/tile_super2.webp DELETED
Binary file (47.8 kB)
 
images/tile_super2_9upscale.webp DELETED
Binary file (368 kB)