File size: 3,234 Bytes
652d24a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d45c86e
 
652d24a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
---
license: mit
tags:
- stable diffusion
- animatediff
- motion lora
language:
- en
---

- [Walking motion LoRAs for Animatediff v2](#walking-motion-loras-for-animatediff-v2)
  - [File summary](#file-summary)
  - [General recommendation](#general-recommendation)
  - [Details and examples](#details-and-examples)
    - [Walking front view](#walking-front-view)
    - [Walking back view](#walking-back-view)
    - [Walking right view](#walking-right-view)
    - [Walking left view](#walking-left-view)

# Walking motion LoRAs for Animatediff v2

## File summary

| Name                                                       | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
| ---------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
| 1900_cseti_6931403_walking-frontview-8vid_mv2.safetensors  | v2                      | (3:2)         | 16     | 8            |
| 1600_cseti_1065173_walking-backview-8vid_mv2.safetensors   | v2                      | (3:2)         | 16     | 8            |
| 1100_cseti_6134549_walking-left-sideview-3vid.safetensors  | v2                      | (3:2)         | 16     | 3            |
| 1100_cseti_8836021_walking-right-sideview-3vid.safetensors | v2                      | (3:2)         | 16     | 3            |


## General recommendation

- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
- Animatediff v3 adapter lora is recommended regardless they are v2 models
- If you want more motion try incrasing the scale multival (e.g. to 1.2)
- I recommend using the above Base AR (Aspect ratio) for inference
- Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.

## Details and examples

### Walking front view
- Recommended keywords: front-view, walking
- LoRA strength: 0.8-1.0
- scale multival / motion scale: 1.0-1.2

<video controls src="https://huggingface.co./Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>

### Walking back view
- Recommended keywords: back-view, walking
- LoRA strength: 0.8-1.0
- scale multival / motion scale: 1.0-1.2

<video controls src="https://huggingface.co./Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>

### Walking right view
- Recommended keywords: side-view, facing right, walking
- LoRA strength: 0.5-1.0
- scale multival / motion scale: 1.0-1.2

<video controls src="https://huggingface.co./Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>

### Walking left view
- Recommended keywords: side-view, facing left, walking
- LoRA strength: 0.5-1.0
- scale multival / motion scale: 1.0-1.2

<video controls src="https://huggingface.co./Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>