Ciara commited on
Commit
be4b936
1 Parent(s): 7a5565f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -11
README.md CHANGED
@@ -1,21 +1,27 @@
1
  ---
2
  license: openrail
3
  ---
4
- Beta version of TemporalNet, to improve temporal consistency for results like this: https://twitter.com/CiaraRowles1/status/1637486561917906944
5
 
6
- Note: this will not remove all flickering, just reduce it, especially at higher denoise levels.
7
-
8
- The best results will probably be achieved with this and several other methods in conjunction.
9
 
10
  Instructions for Use:
11
 
12
- 1) Make a Folder with a folder called "Input_Images" containing the input frames, a png called init.png that is already stylized in the style you want and the temporalvideo.py script.)
13
- 2) modify the temporalvideo.py script with any changes you want, i.e the resolution for the image, the prompt and the controlnet settings.
14
- 3) Run Automatic1111s Web UI with the --api setting enabled.
15
- 4) Run the python script.
 
 
 
16
 
17
- Note: The init image will not significantly affect the style of the output video, it's just to ensure there isn't a big jump in aesthetic over the first few frames.
 
 
 
 
18
 
19
  ToDo:
20
- 1) Write an extension to work with this so you can just use it out of the web ui.
21
- 2) Add functionality so the init image will auto-generate if none is provided.
 
 
1
  ---
2
  license: openrail
3
  ---
4
+ Introducing the Beta Version of TemporalNet
5
 
6
+ TemporalNet is designed to enhance the temporal consistency of generated outputs, as demonstrated in this example: https://twitter.com/CiaraRowles1/status/1637486561917906944. While it does not eliminate all flickering, it significantly reduces it, particularly at higher denoise levels. For optimal results, it is recommended to use TemporalNet in combination with other methods.
 
 
7
 
8
  Instructions for Use:
9
 
10
+ 1) Create a folder that contains:
11
+
12
+ - A subfolder named "Input_Images" with the input frames
13
+ - A PNG file called "init.png" that is pre-stylized in your desired style
14
+ - The "temporalvideo.py" script
15
+
16
+ 2) Customize the "temporalvideo.py" script according to your preferences, such as the image resolution, prompt, and control net settings.
17
 
18
+ 3) Launch Automatic1111's Web UI with the --api setting enabled.
19
+
20
+ 4) Execute the Python script.
21
+
22
+ Please note that the "init.png" image will not significantly influence the style of the output video. Its primary purpose is to prevent a drastic change in aesthetics during the first few frames.
23
 
24
  ToDo:
25
+
26
+ Develop an extension for seamless integration with the web UI.
27
+ Introduce a feature that automatically generates an "init.png" image if none is provided.