sd3-civitai-lora

This is a LoRA derived from stabilityai/stable-diffusion-3-medium-diffusers.

The main validation prompt used during training was:

A hauntingly eerie illustration of a human skull with fully articulated legs, standing upright, jaw slightly ajar revealing teeth, set against a stark, dark background, with the skull's pale bones starkly contrasting the surrounding shadows, capturing a surreal fusion of human anatomy and skeletal structure in a single, chilling composition.

Validation settings

CFG: 7.5
CFG Rescale: 0.0
Steps: 30
Sampler: euler
Seed: 42
Resolution: 1024

Note: The validation settings are not necessarily the same as the training settings.

You can find some example images in the following gallery:

Prompt
unconditional (blank prompt)

Negative Prompt
blurry, cropped, ugly

Prompt
A hauntingly eerie illustration of a human skull with fully articulated legs, standing upright, jaw slightly ajar revealing teeth, set against a stark, dark background, with the skull's pale bones starkly contrasting the surrounding shadows, capturing a surreal fusion of human anatomy and skeletal structure in a single, chilling composition.

Negative Prompt
blurry, cropped, ugly

The text encoder was not trained. You may reuse the base model text encoder for inference.

Training settings

Training epochs: 2
Training steps: 300
Learning rate: 8e-07
Effective batch size: 8
- Micro-batch size: 1
- Gradient accumulation steps: 4
- Number of GPUs: 2
Prediction type: epsilon
Rescaled betas zero SNR: False
Optimizer: AdamW, stochastic bf16
Precision: Pure BF16
Xformers: Not used
LoRA Rank: 16
LoRA Alpha: 16
LoRA Dropout: 0.1
LoRA initialisation style: default

Datasets

civitai-images

Repeats: 0
Total number of images: ~872
Total number of aspect buckets: 1
Resolution: 1024 px
Cropped: True
Crop style: center
Crop aspect: square

Inference

First, make sure you have the latest version of diffusers

pip install git+https://github.com/huggingface/diffusers.git

or (if the newer version is released)

pip install diffusers==0.30.0

Then, use this code here

import torch
from diffusers import StableDiffusion3Pipeline as DiffusionPipeline

model_id = "stabilityai/stable-diffusion-3-medium-diffusers"
adapter_id = "MohamedRashad/sd3-civitai-lora"

prompt = "A digital artwork capturing a serene moment between a young woman and a black cat, set against a cloudy blue sky with white fluffy clouds and delicate flowers at the bottom. The woman, with her long, wavy pink hair, is elegantly dressed in a blue top featuring a collar, complemented by a flower accessory and a heart-shaped earring. Her striking blue eyes reflect a sense of calm and connection. The black cat, with its glossy coat and a distinctive purple collar, shares a close, affectionate gaze with the woman. The scene is bathed in soft, natural light, with the sun casting a warm, inviting glow on the woman's face, creating a harmonious contrast with the cool, tranquil hues of the sky. The image embodies the essence of 1980s anime, characterized by its pastel color palette and an overall atmosphere of beauty and peacefulness. The artwork is meticulously rendered, showcasing the intricate details of the characters' features, the lush textures of their hair and fur, and the subtle nuances of the environment, all contributing to a visually captivating and emotionally resonant scene."
negative_prompt = "blurry, cropped, ugly"

pipeline = DiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16).to(
    "cuda"
)
pipeline.load_lora_weights(adapter_id)
image = pipeline(
    prompt=prompt,
    negative_prompt=negative_prompt,
    num_inference_steps=30,
    generator=torch.Generator(device="cuda").manual_seed(1641421826),
    width=1024,
    height=1024,
    guidance_scale=7.5,
).images[0]
image.save("output.png", format="PNG")