Chan-Y commited on
Commit
297d8c5
1 Parent(s): 7496e3f

Upload folder using huggingface_hub

Browse files
README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - stable-diffusion-xl
4
+ - stable-diffusion-xl-diffusers
5
+ - text-to-image
6
+ - diffusers
7
+ - lora
8
+ - template:sd-lora
9
+ widget:
10
+
11
+ - text: 'in the style of TOK'
12
+
13
+ base_model: stabilityai/stable-diffusion-xl-base-1.0
14
+ instance_prompt: in the style of TOK
15
+ license: openrail++
16
+ ---
17
+
18
+ # SDXL LoRA DreamBooth - besni
19
+
20
+ <Gallery />
21
+
22
+ ## Model description
23
+
24
+ ### These are besni LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.
25
+
26
+ ## Download model
27
+
28
+ ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
29
+
30
+ - **LoRA**: download **[`besni.safetensors` here 💾](/besni/blob/main/besni.safetensors)**.
31
+ - Place it on your `models/Lora` folder.
32
+ - On AUTOMATIC1111, load the LoRA by adding `<lora:besni:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
33
+
34
+
35
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
36
+
37
+ ```py
38
+ from diffusers import AutoPipelineForText2Image
39
+ import torch
40
+
41
+ pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
42
+ pipeline.load_lora_weights('besni', weight_name='pytorch_lora_weights.safetensors')
43
+
44
+ image = pipeline('in the style of TOK').images[0]
45
+ ```
46
+
47
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
48
+
49
+ ## Trigger words
50
+
51
+ You should use in the style of TOK to trigger the image generation.
52
+
53
+ ## Details
54
+ All [Files & versions](/besni/tree/main).
55
+
56
+ The weights were trained using [🧨 diffusers Advanced Dreambooth Training Script](https://github.com/huggingface/diffusers/blob/main/examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py).
57
+
58
+ LoRA for the text encoder was enabled. True.
59
+
60
+ Pivotal tuning was enabled: False.
61
+
62
+ Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
63
+
besni.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1127b35d6556bed75c8a932c678fae76a76ad657385fa460ffd7755cc994542
3
+ size 237421752
logs/dreambooth-lora-sd-xl/1721281417.9758801/events.out.tfevents.1721281417.r-chan-y-autotrain-besni-3aka2y6e-952d0-uxbyt.194.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:054e1f2a22864a65a801e50efa8d67d858838ecf3aa889397136b171cab41477
3
+ size 3600
logs/dreambooth-lora-sd-xl/1721281417.977185/hparams.yml ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: null
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: true
9
+ caption_column: prompt
10
+ center_crop: false
11
+ checkpointing_steps: 100000
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ crops_coords_top_left_h: 0
16
+ crops_coords_top_left_w: 0
17
+ dataloader_num_workers: 0
18
+ dataset_config_name: null
19
+ dataset_name: ./f6b1fb0d-1006-4c69-8241-6fb2270d9c13
20
+ enable_xformers_memory_efficient_attention: false
21
+ gradient_accumulation_steps: 1
22
+ gradient_checkpointing: true
23
+ hub_model_id: null
24
+ hub_token: null
25
+ image_column: image
26
+ instance_data_dir: null
27
+ instance_prompt: in the style of TOK
28
+ learning_rate: 0.0005
29
+ local_rank: -1
30
+ logging_dir: logs
31
+ lr_num_cycles: 1
32
+ lr_power: 1.0
33
+ lr_scheduler: constant
34
+ lr_warmup_steps: 0
35
+ max_grad_norm: 1.0
36
+ max_train_steps: 1500
37
+ mixed_precision: bf16
38
+ noise_offset: 0
39
+ num_class_images: 100
40
+ num_new_tokens_per_abstraction: 2
41
+ num_train_epochs: 7
42
+ num_validation_images: 4
43
+ optimizer: adamW
44
+ output_dir: besni
45
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
46
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
47
+ prior_generation_precision: null
48
+ prior_loss_weight: 1.0
49
+ prodigy_beta3: null
50
+ prodigy_decouple: true
51
+ prodigy_safeguard_warmup: true
52
+ prodigy_use_bias_correction: true
53
+ push_to_hub: false
54
+ rank: 32
55
+ repeats: 12
56
+ report_to: tensorboard
57
+ resolution: 1024
58
+ resume_from_checkpoint: null
59
+ revision: null
60
+ sample_batch_size: 4
61
+ scale_lr: false
62
+ seed: 42
63
+ snr_gamma: 5.0
64
+ text_encoder_lr: 5.0e-05
65
+ token_abstraction: TOK
66
+ train_batch_size: 2
67
+ train_text_encoder: true
68
+ train_text_encoder_frac: 0.8
69
+ train_text_encoder_ti: false
70
+ train_text_encoder_ti_frac: 0.5
71
+ use_8bit_adam: false
72
+ validation_epochs: 50
73
+ validation_prompt: null
74
+ variant: null
75
+ with_prior_preservation: false
logs/dreambooth-lora-sd-xl/events.out.tfevents.1721281417.r-chan-y-autotrain-besni-3aka2y6e-952d0-uxbyt.194.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dddfc36168647769b2498a0657fbc130f8ab652509d9a7da585acf054c47a8c
3
+ size 125834
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dde383222ee69dbd98b7d6cc4f903cdc6edab413b76a626b345268696dbee68f
3
+ size 237400944