AlekseyCalvin
commited on
Commit
•
085002f
1
Parent(s):
f581f61
Update README.md
Browse files
README.md
CHANGED
@@ -148,9 +148,10 @@ Model trained with [AI Toolkit by Ostris](https://github.com/ostris/ai-toolkit)
|
|
148 |
*Dim:16 Alpha:32 Optimizer:Ademamix8bit LR:2e-4* **More info below!** <br>
|
149 |
Fine-tuned using the **Google Colab Notebook*** Version of **ai-toolkit**.<br>
|
150 |
I've used A100 via Colab Pro.
|
151 |
-
However, training SD3.5 may potentially work with Free Colab or lower
|
152 |
Especially if one were to use:<br> ...Say, *lower rank (try 4 or 8), dataset size (in terms of caching/bucketing/pre-loading impacts), 1 batch size, Adamw8bit optimizer, 512 resolution, maybe adding the /lowvram, true/ argument, and plausibly specifying alternate quantization variants.* <br>
|
153 |
-
Generally, VRAM expenditures tend to be lower than for Flux during training
|
|
|
154 |
**To use on Colab**, modify a Flux template Notebook from [here](https://github.com/ostris/ai-toolkit/tree/main/notebooks) with parameters from Ostris' example config for SD3.5 [here](https://github.com/ostris/ai-toolkit/blob/main/config/examples/train_lora_sd35_large_24gb.yaml)!
|
155 |
```
|
156 |
job: extension
|
|
|
148 |
*Dim:16 Alpha:32 Optimizer:Ademamix8bit LR:2e-4* **More info below!** <br>
|
149 |
Fine-tuned using the **Google Colab Notebook*** Version of **ai-toolkit**.<br>
|
150 |
I've used A100 via Colab Pro.
|
151 |
+
However, training SD3.5 may potentially work with Free Colab or lower VRAM in general:<br>
|
152 |
Especially if one were to use:<br> ...Say, *lower rank (try 4 or 8), dataset size (in terms of caching/bucketing/pre-loading impacts), 1 batch size, Adamw8bit optimizer, 512 resolution, maybe adding the /lowvram, true/ argument, and plausibly specifying alternate quantization variants.* <br>
|
153 |
+
Generally, VRAM expenditures for fine-tuning SD3.5 tend to be lower than for Flux during training.<br>
|
154 |
+
So, try it!<br>
|
155 |
**To use on Colab**, modify a Flux template Notebook from [here](https://github.com/ostris/ai-toolkit/tree/main/notebooks) with parameters from Ostris' example config for SD3.5 [here](https://github.com/ostris/ai-toolkit/blob/main/config/examples/train_lora_sd35_large_24gb.yaml)!
|
156 |
```
|
157 |
job: extension
|