metadata

tags:
  - text-to-image
  - lora
  - diffusers
  - template:diffusion-lora
widget:
  - text: >-
      lego --fref --89890, a Lego Star Wars figure stands in a pile of snow. The
      figure is adorned with a white snow-covered hat, a white coat, and a black
      and white striped jacket. The face of the figure is yellow, and the eyes
      are blue. The background is a grayish-gray color, and there are small
      white dots dotting the top of the image.
    output:
      url: images/1.png
  - text: >-
      lego --fref --89890, a toy robot is soaring through the air. The robot is
      dressed in a red jumpsuit, adorned with a black helmet and goggles. The
      toy is holding a small camera in its right hand. The camera has a black
      lens, and a yellow handle. The sky is a deep blue, dotted with white
      clouds, adding a pop of color to the scene.
    output:
      url: images/2.png
  - text: >-
      lego --fref --89890, a lego robot is soaring through the air on a dirt
      bike. The robot is wearing a white helmet, a white shirt, and a brown and
      orange vest. The bike is soaring over a pile of brown rocks, with a body
      of water in the background. The sky is filled with clouds, and the sun is
      peeking through the clouds, adding a warm glow to the scene.
    output:
      url: images/3.png
  - text: >-
      lego --fref --89890, a lego astronaut is standing on a rocky surface,
      holding a flag with a white pole. The astronaut is wearing a white helmet,
      a white and red uniform, and black gloves. The background is blurred,
      creating a stark contrast with the astronaut and the flag. The flag is
      adorned with an orange and white striped flag, adding a pop of color to
      the scene.
    output:
      url: images/4.png
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: lego --fref --89890
license: creativeml-openrail-m

Flux-Lego-Ref-LoRA

Prompt
lego --fref --89890, a Lego Star Wars figure stands in a pile of snow. The figure is adorned with a white snow-covered hat, a white coat, and a black and white striped jacket. The face of the figure is yellow, and the eyes are blue. The background is a grayish-gray color, and there are small white dots dotting the top of the image.

Prompt
lego --fref --89890, a toy robot is soaring through the air. The robot is dressed in a red jumpsuit, adorned with a black helmet and goggles. The toy is holding a small camera in its right hand. The camera has a black lens, and a yellow handle. The sky is a deep blue, dotted with white clouds, adding a pop of color to the scene.

Prompt
lego --fref --89890, a lego robot is soaring through the air on a dirt bike. The robot is wearing a white helmet, a white shirt, and a brown and orange vest. The bike is soaring over a pile of brown rocks, with a body of water in the background. The sky is filled with clouds, and the sun is peeking through the clouds, adding a warm glow to the scene.

Prompt
lego --fref --89890, a lego astronaut is standing on a rocky surface, holding a flag with a white pole. The astronaut is wearing a white helmet, a white and red uniform, and black gloves. The background is blurred, creating a stark contrast with the astronaut and the flag. The flag is adorned with an orange and white striped flag, adding a pop of color to the scene.

The model is still in the training phase. This is not the final version and may contain artifacts and perform poorly in some cases.

Model description

prithivMLmods/Flux-Lego-Ref-LoRA

Image Processing Parameters

Parameter	Value	Parameter	Value
LR Scheduler	constant	Noise Offset	0.03
Optimizer	AdamW	Multires Noise Discount	0.1
Network Dim	64	Multires Noise Iterations	10
Network Alpha	32	Repeat & Steps	17 & 2350
Epoch	10	Save Every N Epochs	1

Labeling: florence2-en(natural language & English)

Total Images Used for Training : 15

Best Dimensions & Inference

Dimensions	Aspect Ratio	Recommendation
1280 x 832	3:2	Best
1024 x 1024	1:1	Default

Inference Range

Recommended Inference Steps: 30–35

Setting Up

import torch
from pipelines import DiffusionPipeline

base_model = "black-forest-labs/FLUX.1-dev"
pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16)

lora_repo = "prithivMLmods/Flux-Lego-Ref-LoRA"
trigger_word = "lego --fref --89890"  
pipe.load_lora_weights(lora_repo)

device = torch.device("cuda")
pipe.to(device)

Trigger words

You should use lego --fref --89890 to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.