|
--- |
|
license: openrail |
|
--- |
|
Beta version of TemporalNet, to improve temporal consistency for results like this: https://twitter.com/CiaraRowles1/status/1637486561917906944 |
|
|
|
Note: this will not remove all flickering, just reduce it, especially at higher denoise levels. |
|
|
|
The best results will probably be achieved with this and several other methods in conjunction. |
|
|
|
Instructions for Use: |
|
|
|
1) Make a Folder with a folder called "New Folder" containing the input frames, a png called init.png that is already stylized in the style you want and the temporalvideo.py script.) |
|
2) modify the temporalvideo.py script with any changes you want, i.e the resolution for the image, the prompt and the controlnet settings. |
|
3) Run Automatic1111s Web UI with the --api setting enabled. |
|
4) Run the python script. |
|
|
|
Note: The init image will not significantly affect the style of the output video, it's just to ensure there isn't a big jump in aesthetic over the first few frames. |
|
|
|
ToDo: |
|
1) Write an extension to work with this so you can just use it out of the web ui. |
|
2) Add functionality so the init image will auto-generate if none is provided. |