init

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.png filter=lfs diff=lfs merge=lfs -text

.gitignore

@@ -0,0 +1 @@
+raw/

README.md

@@ -1,3 +1,76 @@
 ---
 license: cc-by-nc-4.0
+base_model: stabilityai/stable-diffusion-xl-base-1.0
+dataset: sshh12/planet-textures
+tags:
+  - stable-diffusion-xl
+  - stable-diffusion-xl-diffusers
+  - text-to-image
+  - diffusers
+  - lora
+  - planets
+  - space
+  - procedural-generation
+inference: false
 ---
+
+These are LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0. The weights were fine-tuned on the sshh12/planet-textures dataset.
+
+Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.
+
+| Prompt                                                                                                                              | Image                                                                                                                                                           |
+| ----------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| A turquoise-hued gas giant, streaked with swirling white wisps of high-altitude clouds, wrapped in a thin, multicolored ring system | ![img_1](./imgs/img_aturquoise-huedgasgiantstreakedwithswirlingwhitewispsofhigh-altitudecloudswrappedinathinmulticoloredringsystem_ckpt1300_gs20.0_seed100.png) |
+| A barren desert planet, coated in fine rusty-red sand, pockmarked with deep, dark craters, and cloaked in a thin, hazy atmosphere   | ![img_2](./imgs/img_abarrendesertplanetcoatedinfinerusty-redsandpockmarkedwithdeepdarkcratersandcloakedinathinhazyatmosphere_ckpt2000_gs10.0_seed0.png)         |
+| A small, icy moon, encased in a shell of pure white ice and dust, covered with intricate patterns of frosty fissures                | ![img_3](./imgs/img_asmallicymoonencasedinashellofpurewhiteiceanddustcoveredwithintricatepatternsoffrostyfissures_ckpt2000_gs10.0_seed0.png)                    |
+
+## 🧨 Diffusers Usage
+
+```py
+import torch
+from diffusers import DiffusionPipeline, AutoencoderKL
+
+vae = AutoencoderKL.from_pretrained("madebyollin/sdxl-vae-fp16-fix", torch_dtype=torch.float16)
+pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", vae=vae, torch_dtype=torch.float16, variant="fp16", use_safetensors=True)
+pipe.load_lora_weights("sshh12/sdxl-lora-planet-textures")
+pipe.to("cuda")
+
+prompt = "A dwarf planet exhibiting a striking purple color, with a surface peppered with craters and towering ice formations"
+negative_prompt = 'blurry, fuzzy, low resolution, cartoon, painting'
+
+image = pipe(prompt=prompt, negative_prompt=negative_prompt, width=1024, height=512).images[0]
+image
+```
+
+## Training
+
+GitHub: https://github.com/sshh12/planet-diffusion
+
+```py
+MODEL_NAME="stabilityai/stable-diffusion-xl-base-1.0"
+DATASET_NAME="sshh12/planet-textures"
+
+!accelerate launch v2/train_text_to_image_lora_sdxl.py \
+  --pretrained_model_name_or_path="$MODEL_NAME" \
+  --pretrained_vae_model_name_or_path="madebyollin/sdxl-vae-fp16-fix" \
+  --dataset_name="$DATASET_NAME" \
+  --caption_column="text" \
+  --width=1024 \
+  --height=512 \
+  --random_hflip \
+  --random_vflip \
+  --mixed_precision="fp16" \
+  --use_8bit_adam \
+  --train_batch_size=1 \
+  --gradient_accumulation_steps=2 \
+  --num_train_epochs=500 \
+  --checkpointing_steps=100 \
+  --learning_rate=1e-05 \
+  --lr_scheduler="constant" \
+  --lr_warmup_steps=0 \
+  --seed=0 \
+  --validation_epochs=5 \
+  --validation_prompt_file="v2/validation_prompts.txt" \
+  --enable_xformers_memory_efficient_attention \
+  --report_to="wandb"
+```

checkpoint-1000/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b0a2896d888dee5ec380e075a014b0e4e0580421d950d11e7a725155a1aea471
+size 23664755

checkpoint-1100/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cf85315ac938021c0f5c58a89d5d44ee3dd71cd22bf6f5fb793dbdaa4c0686ca
+size 23664755

checkpoint-1200/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db0295defb533bdae82ed19b4b09992503d4a83d6d64db6abd7e5509d90e8b7c
+size 23664755

checkpoint-1300/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6612209a2b4348c24ee943cd2e12d229318fca62560fdf6ebd82267cc180f36
+size 23664755

checkpoint-1400/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:285c58692e251f90aa25b307cf55c344e0e360a89d996aa4442c18d81f6566b9
+size 23664755

checkpoint-1500/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:578abc2cf48423eeef9a421f4e07dad41e0773a6f5e6e0862688cc3821683b1e
+size 23664755

checkpoint-1600/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:27de9dbed11c13f32f9f03ec1cc7e5edca67a0fab29e753f674c7414aab547ea
+size 23664755

checkpoint-1700/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1678191e09fc34d5956f577475e2e5851a1f85acdceab3e60f2c8711aae30aae
+size 23664755

checkpoint-1800/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7523f8e886f453d330ccb475a893a1c7d0949101f7b9ca688203e89dd0c51be6
+size 23664755

checkpoint-1900/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7727d08e4337bffde82a6210545378346df29797cd6eae240a5cfd354fa9712
+size 23664755

checkpoint-2000/pytorch_lora_weights.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b16651cbb014672dda4ae0f5bb0dfa0f965581ab549d44b22878b30e0b02b92f
+size 23664755