gj3ka1 commited on
Commit
be3b49d
verified
1 Parent(s): 3d65edd

Update Readme

Browse files
Files changed (1) hide show
  1. README.md +63 -70
README.md CHANGED
@@ -1,71 +1,64 @@
1
- ---
2
- license: mit
3
- datasets:
4
- - trojblue/test-HunyuanVideo-anime-stills
5
- base_model:
6
- - tencent/HunyuanVideo
7
- pipeline_tag: text-to-video
8
- tags:
9
- - hunyuan-video
10
- - text-to-video
11
- - lora
12
- - diffusers
13
- - template:diffusion-lora
14
- instance_prompt: anime
15
- widget:
16
- - text: 'anime girl 1girl, alcohol carton, blush, braid, bridge, crosswalk, dress, green dress, holding carton, long hair, long sleeves, multiple girls, night, open mouth, outdoors, pedestrian bridge, purple eyes, red hair, single braid, solo focus, spaghetti strap'
17
- output:
18
- url: samples/ComfyUI_00017_.webp
19
- - text: '<prompt in metadata>'
20
- output:
21
- url: samples/ComfyUI_00024_.webp
22
- - text: '<prompt in metadata>'
23
- output:
24
- url: samples/ComfyUI_00068_.webp
25
- - text: 'anime scene of a vibrant carnival with colorful rides, games, and food stalls, and a clown handing balloons to a group of laughing children.'
26
- output:
27
- url: samples/ComfyUI_00071_.webp
28
- ---
29
-
30
- # **AnimaEngine**
31
-
32
- <Gallery />
33
-
34
-
35
- [v0.1 - testing version]
36
-
37
-
38
-
39
- An anime-style lora trained on anime screencaps and illustrations, aimed to create vibrant, bright and colorful anime style motions. It's good at generating single person motions (and girls better than boys).
40
-
41
-
42
-
43
- ## Usage
44
-
45
- To use the lora (and to use HunyuanVideo in general) in ComfyUI, it's recommended to install the [VideoHelperSuite](https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite), and update to torch 2.5.1+cu124:
46
-
47
- ```
48
- pip install -U torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu124
49
- ```
50
-
51
-
52
-
53
- A sample workflow for using the lora can be found in the Huggingface repo:
54
-
55
- - [v0.1/ComfyUI_00024_.webp 路 trojblue/HunyuanVideo-lora-AnimeShot at main](https://huggingface.co/trojblue/HunyuanVideo-lora-AnimeShot/blob/main/v0.1/ComfyUI_00024_.webp)
56
-
57
-
58
-
59
- ## Prompting
60
-
61
- Use prompts in the format of `anime <subject> <description>` to get the best results, use resolution `544x960` (and usually horizontal works a little bit better than vertical). for example:
62
-
63
-
64
-
65
- - anime girl with pink twin tails and green eyes, wearing a school uniform, holding a stack of books in a bustling library filled with sunlight streaming through tall windows.
66
- - anime boy with silver hair and blue eyes, wearing a casual hoodie, sitting on a park bench, feeding pigeons with a gentle smile.
67
- - anime girl 1girl, alcohol carton, blush, braid, bridge, crosswalk, dress, green dress, holding carton, long hair, long sleeves, multiple girls, night, open mouth, outdoors, pedestrian bridge, purple eyes, red hair, single braid, solo focus, spaghetti strap
68
-
69
- ## Limitations
70
-
71
  It's trained as a test model so sometimes when body movements are large it gets disconnected. Also some concepts are less anime-like compared to others. I do plan to update the model later with more training time and dataset.
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - trojblue/test-HunyuanVideo-anime-stills
5
+ base_model:
6
+ - tencent/HunyuanVideo
7
+ pipeline_tag: text-to-video
8
+ tags:
9
+ - hunyuan-video
10
+ - text-to-video
11
+ - lora
12
+ - diffusers
13
+ - template:diffusion-lora
14
+ instance_prompt: anime
15
+ widget:
16
+ - text: 'anime girl 1girl, alcohol carton, blush, braid, bridge, crosswalk, dress, green dress, holding carton, long hair, long sleeves, multiple girls, night, open mouth, outdoors, pedestrian bridge, purple eyes, red hair, single braid, solo focus, spaghetti strap'
17
+ output:
18
+ url: samples/ComfyUI_00017_.webp
19
+ - text: '<prompt in metadata>'
20
+ output:
21
+ url: samples/ComfyUI_00024_.webp
22
+ - text: '<prompt in metadata>'
23
+ output:
24
+ url: samples/ComfyUI_00068_.webp
25
+ - text: 'anime scene of a vibrant carnival with colorful rides, games, and food stalls, and a clown handing balloons to a group of laughing children.'
26
+ output:
27
+ url: samples/ComfyUI_00071_.webp
28
+ ---
29
+
30
+ # **AnimaEngine**
31
+
32
+ <Gallery />
33
+
34
+
35
+ [v0.1 - testing version]
36
+
37
+
38
+
39
+ An anime-style lora trained on anime screencaps and illustrations, aimed to create vibrant, bright and colorful anime style motions. It's good at generating single person motions (and girls better than boys).
40
+
41
+
42
+
43
+ ## Usage
44
+
45
+ To use the lora (and to use HunyuanVideo in general) in ComfyUI, it's recommended to install the [VideoHelperSuite](https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite), and update to torch 2.5.1+cu124:
46
+
47
+ ```
48
+ pip install -U torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu124
49
+ ```
50
+
51
+
52
+ ## Prompting
53
+
54
+ Use prompts in the format of `anime <subject> <description>` to get the best results, use resolution `544x960` (and usually horizontal works a little bit better than vertical). for example:
55
+
56
+
57
+
58
+ - anime girl with pink twin tails and green eyes, wearing a school uniform, holding a stack of books in a bustling library filled with sunlight streaming through tall windows.
59
+ - anime boy with silver hair and blue eyes, wearing a casual hoodie, sitting on a park bench, feeding pigeons with a gentle smile.
60
+ - anime girl 1girl, alcohol carton, blush, braid, bridge, crosswalk, dress, green dress, holding carton, long hair, long sleeves, multiple girls, night, open mouth, outdoors, pedestrian bridge, purple eyes, red hair, single braid, solo focus, spaghetti strap
61
+
62
+ ## Limitations
63
+
 
 
 
 
 
 
 
64
  It's trained as a test model so sometimes when body movements are large it gets disconnected. Also some concepts are less anime-like compared to others. I do plan to update the model later with more training time and dataset.