Unnamed User commited on
Commit
f8223f5
1 Parent(s): 769e42a

v0.9 release

Browse files
README.md CHANGED
@@ -7,7 +7,7 @@ tags:
7
  language:
8
  - en
9
  ---
10
- - [Basic camera motion LoRAs](#basic-camera-motion-loras)
11
  - [Model Description](#model-description)
12
  - [File summary](#file-summary)
13
  - [General recommendation](#general-recommendation)
@@ -17,27 +17,29 @@ language:
17
  - [Walking right view](#walking-right-view)
18
  - [Walking left view](#walking-left-view)
19
 
20
- # Basic camera motion LoRAs
21
 
22
  ## Model Description
23
- This repository contains a collection of motion LoRAs finetuned on Animatediff v2 models.
24
 
25
  ## File summary
26
 
27
- | Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
28
- | ---------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
29
- | 1900_cseti_6931403_walking-frontview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
30
- | 1600_cseti_1065173_walking-backview-8vid_mv2.safetensors | v2 | (3:2) | 16 | 8 |
31
- | 1100_cseti_6134549_walking-left-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
32
- | 1100_cseti_8836021_walking-right-sideview-3vid.safetensors | v2 | (3:2) | 16 | 3 |
 
 
 
33
 
34
 
35
  ## General recommendation
36
-
37
  - These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
38
- - They work with SD 1.5
39
- - Animatediff v3 adapter lora is recommended regardless they are v2 models
40
- - If you want more motion try incrasing the scale multival (e.g. to 1.2)
41
  - I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
42
  - Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
43
  - I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
@@ -45,29 +47,17 @@ This repository contains a collection of motion LoRAs finetuned on Animatediff v
45
  ## Details and examples
46
 
47
  ### Walking front view
48
- - Recommended keywords: front-view, walking
49
- - LoRA strength: 0.8-1.0
50
- - scale multival / motion scale: 1.0-1.2
51
 
52
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
53
 
54
  ### Walking back view
55
- - Recommended keywords: back-view, walking
56
- - LoRA strength: 0.8-1.0
57
- - scale multival / motion scale: 1.0-1.2
58
 
59
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
60
 
61
  ### Walking right view
62
- - Recommended keywords: side-view, facing right, walking
63
- - LoRA strength: 0.5-1.0
64
- - scale multival / motion scale: 1.0-1.2
65
 
66
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
67
 
68
  ### Walking left view
69
- - Recommended keywords: side-view, facing left, walking
70
- - LoRA strength: 0.5-1.0
71
- - scale multival / motion scale: 1.0-1.2
72
 
73
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
 
7
  language:
8
  - en
9
  ---
10
+ - [Basic camera motion LoRAs for Animatediff v2 motion models - version 1](#basic-camera-motion-loras-for-animatediff-v2-motion-models---version-1)
11
  - [Model Description](#model-description)
12
  - [File summary](#file-summary)
13
  - [General recommendation](#general-recommendation)
 
17
  - [Walking right view](#walking-right-view)
18
  - [Walking left view](#walking-left-view)
19
 
20
+ # Basic camera motion LoRAs for Animatediff v2 motion models - version 1
21
 
22
  ## Model Description
23
+ This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations.
24
 
25
  ## File summary
26
 
27
+ | Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
28
+ | ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
29
+ | 1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
30
+ | 1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
31
+ | 2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors | v2 | (3:2) | 32 | 10 |
32
+ | 1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
33
+ | 1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
34
+ | 1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
35
+ | 1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
36
 
37
 
38
  ## General recommendation
 
39
  - These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
40
+ - They work with SD 1.5 checkpoints
41
+ - Animatediff v3 adapter LoRA is recommended regardless they are v2 models
42
+ - If you want more motion try increasing the scale multival
43
  - I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
44
  - Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
45
  - I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
 
47
  ## Details and examples
48
 
49
  ### Walking front view
 
 
 
50
 
51
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
52
 
53
  ### Walking back view
 
 
 
54
 
55
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
56
 
57
  ### Walking right view
 
 
 
58
 
59
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
60
 
61
  ### Walking left view
 
 
 
62
 
63
  <video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
loras/1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:388ecea81058f0ae5c995497720834203f4e9c1d270b0472aa7509389e237bae
3
+ size 118348392
loras/1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5cdb3dc07c64d1baaa288c2cc7747cbcfae61a1276632b5e89aead7257764ab
3
+ size 118348392
loras/1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3d18d62579d78440baea16c97861b071831c3e98282fe2cd06eb0970022846e
3
+ size 118348392
loras/1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eeecc684ed8a2abf7051067a9ab2de2e602586e8f7eaf651ed5ea1738555f7e8
3
+ size 118348392
loras/1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7c660048062a0d87ea05832439a4ed5c85ea9de8127e2132d0d07ac12faee26
3
+ size 118348392
loras/1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e538b0ad4848fd27240edccf28ace73d5d54949da74a44dcb70738c3a31479f8
3
+ size 118348392
loras/2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:693651ab6a8fb20fcf85339cbebd41650458e1d2fbb4e5af4ec1f13a06bd8a2d
3
+ size 118348392