license: openrail
2d pixel art (beta) embedding for SD 2.0 768px
Hi - I am a big fan of retro/nostalgia things. This is the reason why I made this embedding. I have trained it on 70 images, the version I will be targeting in upcoming weeks will be based on 128 or 256 well-selected and filtered images, and processed through pixelate tool to keep the same pixel size on each of the input data. This should improve the embedding dramatically.
Images:
Installation:
Just drop the embedding files (.pt extension) to your SD embeddings folder (your-folder/embeddings).
Restart the app if running. Use the keyword as a filename ("pixelart" for example). You can rename them as you wish.
Before we start: cool tool to enhance your results even further: link
Version of Stable Diffusion: 2.0 - 768
Supported diffusers:
- Euler a (Preffered)
- DDIM
- other (partially)
Embeddings
pixelart: The most generic one. Usually gives decent pixels, reads quite well prompts, is not to "old-school". Used for "pixelating process" in img2img.
pixelart-soft: The softer version of an embedding. One of the most generic ones.Usually good for characters.
pixelart-hard: More pixelated version of embedding. Vintage/old-school. Depends on the topic - can be colorful or very vintage/dull.
pixelart-1 & pixelart-2: less generic ones. These sometimes give even better results than original (depends on topic, tags and diffuser)
pixelizer: Fun but chaotic one. Good for some experiments but usually gives colorful 8-bit like pixelated platformers/game screens stuff. I have left that one for experiments or as a factor for combination with other ones.
Usage
I highly recommend use these embeddings with Euler a diffuser. It will give usually best results. In some cases it would be
good to use negative prompts. Sometimes for testing if you caught good composition/colors - you might add or remove them
to impact the image.
Img2img
The embeddings give you a great opportunity to change some of your works into pixel ones. The best way to do it is to follow this process:
First get your subject. If this is a simple image as:
Here it needed just one step!
What I did here was to use: Positive prompt: "game icon, raven, by pixelart, pixelated" (very important to add pixelated) Negative prompt: none (recommended, but you can of course experiment, especially if subject needs that) Sampler: Euler a (needed for any pixelation) steps: 20, CFG: 7, Denoising: 0.58. Resolution: 768x768.
The result:
Of course, the result can be better - you can re-roll to infinity or choose better settings or different embedding than recommended pixelart (in some cases you can try others)
Pixelating photos/more complex images: This is more tricky - but doable. As a baseline use the above settings, you can experiment with higher/lower CFG or denoising. To keep likeness I don't recommend you to go over 0.6 denoising. Replace the first part of the prompt with a simple description, at the end should be part: "by/in style pixelart, pixelated" Probably this will take up to 2-3 rounds. When I like the output - I set it as a base for next iteration. Then I reduce denoising by 0.4 each extra round. Of course this is rough process - might be different based on images.
Here are some examples:
Input:
Resuts:
I still investigating how to improve on the process.