bekushal's picture
Update README.md (#2)
1b8f7f2 verified
metadata
tags:
  - flux
  - text-to-image
  - lora
  - diffusers
  - fal
base_model: black-forest-labs/FLUX.1-dev
instance_prompt: A young indian monk
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co./black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md

Flux_finetune_swami_vevikananda

Inference


import torch
from diffusers import FluxPipeline

pipe = FluxPipeline.from_pretrained("black-forest-labs/FLUX.1-dev", torch_dtype=torch.bfloat16)
pipe.load_lora_weights("bekushal/Flux_finetune_swami_vevikananda", weight_name="Flux_finetune_swami_vevikananda.safetensors")
pipe.fuse_lora(lora_scale=1.0)
pipe.to("cuda")

prompt = "A young Indian monk with sunglasses in a cricket ground, holding a bat in his hand."

image = pipe(prompt, 
             num_inference_steps=24, 
             guidance_scale=3.5,
             width=960, height=1280,
            ).images[0]
image.save(f"example.png")

Model description

This model leverages the powerful Flux architecture, a groundbreaking advancement in the world of Generative AI, specifically designed to generate personalized images. While popular tools like DALLE and MidJourney are great for generic imagery, they fall short when it comes to producing high-quality images of specific individuals. Flux revolutionizes this process by making it easy and affordable to fine-tune models with just a small set of personal images.

In this model, we demonstrate how you can fine-tune the Flux model using just 40 images, resulting in personalized image generation that captures unique facial features and characteristics with high fidelity. Whether you're looking to recreate images of yourself, historical figures, or specific individuals in creative settings, this model opens up new possibilities.

Key trigger words for this model include "A young Indian Monk", inspired by the legendary figure Swami Vivekananda, which helps direct the image generation towards that persona. The fine-tuning process is both efficient and cost-effective, running on Nvidia H100 GPUs for less than USD 2.0 (~INR 170), making this ideal for creative projects such as personalized portraits or thematic photoshoots. Model Use:

Trigger Word: "A young Indian Monk"
Fine-tuned to evoke the likeness of Swami Vivekananda.

Download the model weights in the Safetensors format from the Files & Versions tab to get started.

Trigger words

You should use A young indian monk to trigger the image generation.

Download model

Weights for this model are available in Safetensors format.

Download them in the Files & versions tab.

Training at fal.ai

Training was done using fal.ai/models/fal-ai/flux-lora-fast-training.