|
--- |
|
license: creativeml-openrail-m |
|
--- |
|
### 💥🎨 The Simpsons dreambooth model. |
|
This is a fine-tuned Stable Diffusion model based on The Simpsons. |
|
|
|
Use **asim style** in your prompts. |
|
The model has some trouble with double pupils and no pupils. |
|
Using "cross-eyed" in the negative prompt appears to help? |
|
|
|
### Sample images: |
|
Samples are made with dynamic prompts. Negative prompts: watermark, text, signature, cross-eyed |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_famous_people.png) |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_famous_people2.png) |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_characters.png) |
|
For people / characters: |
|
asim style. dramatic beautiful { headshot | portrait } of \_\_person\_\_ {outside { in a garden | in a desert | on a mountain top | at a roman ruin} {at sunrise | at sunset | on an overcast afternoon | in the rain | in the snow | at night} | inside {a fancy living room | on a movie set | a vast empty dark space | a kaleidoscope | an ancient library} with {spotlights | neon lights | soft mood lighting | firefly lights } }. detailed background. |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_animals.png) |
|
For animals: |
|
asim style. dramatic closeup national geographic image of a \_\_animal\_\_ in its natural habitat. at {sunrise|sunset|night}. detailed background. |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_buildings.png) |
|
asim style. + random prompt from the internet of cool looking structures: steampunk library, tower of babel, tree house, haunted victorian. |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_landscapes.png) |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_famous_places.png) |
|
biomes: |
|
asim style. a beautiful {summer | autumn | winter | spring } landscape panorama painting of \_\_biome\_\_ {at sunrise | at sunset | on an overcast afternoon | in the rain | in the snow | at night} |
|
|
|
famous places: |
|
asim style. a beautiful panorama view of \_\_places\_\_ {at sunrise | at sunset | on a cloudy afternoon | in the rain | covered in snow}. |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_flowers.png) |
|
flowers: |
|
asim style. a beautiful vase of \_\_flower\_\_ flowers. on a balcony table at { sunrise | sunset | night} . nearby a {bottle of {beer | wine} and a half-empty glass | bowl of fruit}. |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_internet_examples.png) |
|
![asim.jpg](https://huggingface.co./PiyarSquare/sd_asim_simpsons/resolve/main/grid_internet_examples2.png) |
|
asim style. + random prompt from the internet. The model mixes well with existing prompts with artists and styles, though not so well with keywords like "photo-realistic." |
|
|
|
Based on StableDiffusion 1.5 model (full weights). |
|
|
|
### Training |
|
Made with [automatic1111 webui](https://github.com/AUTOMATIC1111/stable-diffusion-webui) + [d8ahazard dreambooth extension](https://github.com/d8ahazard/sd_dreambooth_extension) + [nitrosocke guide](https://github.com/nitrosocke/dreambooth-training-guide). |
|
|
|
100 hand-cut training images. |
|
About 70% people, 20% landscapes and 10% animals and objects. |
|
Maybe one too many Cletus. |
|
Detailed captions were written for each image such as: "A wide shot of a 40-year-old Caucasian man with glasses and a mustache. Dressed in a fishing hat, pink shirt, an olive fishing vest with pockets and brown trousers, sitting in a canoe on a lake. The man is fishing with a red fishing rod. There are trees and mountains in the background at sunset with a few clouds in the sky." |
|
|
|
Learning rate was 1.72e-6 for 10,000 steps without prior preservation. |
|
Useful tips from the reddit stablediffusion and the discussions on d8ahazard's extension. |
|
Notes on training on [d8ahazard dreambooth extension discussion](https://github.com/d8ahazard/sd_dreambooth_extension/discussions/443). |
|
|
|
I am excited to see what people do with this and I would like to improve the eyes, if anyone has suggestions. |