---
license: creativeml-openrail-m
language:
- en
datasets:
- FredZhang7/paint-journey-half
tags:
- text-to-image
- stable-diffusion
- disco-diffusion
- art
inference: true
---
## Paint Journey V1 is Dreamlike Diffusion V1 fine-tuned on 260 hand-picked watercolor and digital paintings generated by [Disco Diffusion](https://github.com/alembics/disco-diffusion/blob/main/Disco_Diffusion.ipynb)

Used Linux Dreambooth to teach the model to generate more artistic watercolor and digital paintings. Use the same prompts as you would for stable diffusion v1.5, but start the prompt with `disco` for the style to take effect.
For starters, use a dimension of roughly 768x768 for anything, 768x936 for portraits, and 1056x768 for landscapes. You may also stick to [Dreamlike Diffusion](https://huggingface.co./dreamlike-art/dreamlike-diffusion-1.0) dimensions.

## Paint Journey V2
Work in progress

## Portrait Examples
![](./example_discobeautifulyounglady_portrait.png)

![](./example_discoyoungman_portrait.png)

## Landscape Examples
![](./example_discofuturisticcity.png)

![](./example_discocityoilpainting.png)

![](./example_discolandneartheocean.png)

![](./example_discomountain_landscape.png)

## Outerspace Examples
![](./example_discoalienworld_landscape.png)

![](./example_discodreamlikeartgalaxy.png)

![](./example_discodreamlikeartuniverse.png)


Prompts from top to bottom:
```
a disco painting of a happy young lady, gorgeous beautiful hair, ((beautiful eyes)), medium shot, high resolution wallpaper
Negative prompt: low-res blurry deformed mutated body (((duplicate faces))) (((double head))) (((long neck))) bad anatomy long face extra fingers text watermark
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 895783426, Size: 768x928, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
a disco painting of a young man, smiling, beautiful eyes, half body, high resolution wallpaper
Negative prompt: low-res blurry deformed mutated body ((duplicate faces)) ((double head)) bad anatomy long face long neck extra fingers text watermark signature
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 1616995491, Size: 768x936, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
((disco futuristic city)), dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry deformed fog
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3950043173, Size: 768x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco city, oil and canvas painting, dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3015312670, Size: 768x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco land near the ocean, watercolor painting, sunset, high resolution wallpaper
Negative prompt: low-res blurry deformed smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3299930008, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco oil painting of a mountain, high resolution wallpaper
Negative prompt: low-res blurry smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 753552356, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco beautiful landscape in an alien world, high resolution wallpaper
Negative prompt: low-res blurry smoke
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 3582670051, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco galaxy, dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry smoke sphere
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 386090498, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```
```
disco universe, dreamlikeart, high resolution wallpaper
Negative prompt: low-res blurry
Steps: 40, Sampler: Euler a, CFG scale: 7.5, Seed: 2520017543, Size: 1056x768, Model hash: 4748ee4c, Batch size: 4, Batch pos: 0
```

## WebUI Usage
```
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
```
Download [paint_journey.ckpt](./paint_journey.ckpt) to `./stable-diffusion-webui/models/Stable-diffusion` folder. Run `webui-user.bat`.

## Diffusers Usage
```bash
pip install --upgrade diffusers
```
```python
from diffusers import StableDiffusionPipeline
import torch

pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v1")
pipe = pipe.to("cuda")

prompt = "disco lighthouse near the sea, oil painting, high resolution wallpaper"
image = pipe(prompt).images[0]

image.save("./result.png")
```

## Safety Checker
The official [stable diffusion safety checker](https://huggingface.co./CompVis/stable-diffusion-safety-checker) uses up 1.22GB VRAM. Recommend using [Google Safesearch Mini](https://huggingface.co./FredZhang7/google-safesearch-mini) (99MB) to save 1.12GB VRAM.