MysteryGuitarMan
commited on
Commit
•
94dd666
1
Parent(s):
c62e2df
Update README.md
Browse files
README.md
CHANGED
@@ -7,14 +7,24 @@ tags:
|
|
7 |
# Control-LoRA Model Card
|
8 |
|
9 |
|
10 |
-
##
|
11 |
-
|
12 |
|
13 |
-
By
|
|
|
|
|
|
|
|
|
14 |
|
15 |
### MiDaS and ClipDrop Depth
|
16 |
![canny](samples/depth-sample.jpeg)
|
17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
### Canny Edge
|
19 |
![canny](samples/canny-sample.jpeg)
|
20 |
Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.
|
|
|
7 |
# Control-LoRA Model Card
|
8 |
|
9 |
|
10 |
+
## Introduction
|
11 |
+
What's better than ControlNets for SDXL? ControlNet... but, more efficient.
|
12 |
|
13 |
+
By introducing low-rank parameter efficient fine tuning, we introduce ***Control-LoRAs***.
|
14 |
+
|
15 |
+
Integrating the strengths of both ControlNet and PEFT, this approach offers a more efficient and compact method to bring model control for a wider variety of consumer GPUs.
|
16 |
+
|
17 |
+
For each model below, you'll find `Rank 256` files (reducing the `~4.7GB` ControlNets to `~738MB`) and experimental, ultra-pruned `Rank 128` files (reducing to `~377MB`).
|
18 |
|
19 |
### MiDaS and ClipDrop Depth
|
20 |
![canny](samples/depth-sample.jpeg)
|
21 |
|
22 |
+
Depth estimation is an image processing technique that determines the distance of objects in a scene, providing a depth map that highlights variations in proximity.
|
23 |
+
|
24 |
+
In the example above, we compare the depth results of MiDaS dpt_beit_large_512 with ClipDrop Depth for portraits, and their subsequent use in Depth Control-LoRa.
|
25 |
+
|
26 |
+
The Control-LoRA utilizes a grayscale depth map for guided generation and has been trained on a diverse range of image concepts and aspect ratios.
|
27 |
+
|
28 |
### Canny Edge
|
29 |
![canny](samples/canny-sample.jpeg)
|
30 |
Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.
|