File size: 2,102 Bytes
f8be430 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
Basic camera motion LoRAs for Animatediff v2 motion models - version 1
## Model Description
This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations.
## File summary
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
| ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
| <name>.safetensors | v2 | (1:1) | 32 | 70 |
## How to use
- copy the motion lora files into your "ComfyUI\models\animatediff_motion_lora" folder
- Use the "Load Animatediff LoRA" node
- set the context_length parameter to 32 and context_overlap to 8 (it might work with other values but this is how I tested it)
## Settings and recommendations
- Use it with strength: 0.8
- This motion LoRA is finetuned on a v2 motion model. It works also with AnimateLCM but don't work with v3 models
- It works with SD 1.5 checkpoints
- Animatediff v3 adapter LoRA is recommended regardless it is a v2 model.
- If you want more motion try increasing the scale multival or lower the strength of the v3 adapter LoRA
- Try playing with the strength of
- motion LoRA
- scale multival
- v3_adapter lora
like increasing the scale multival and lowering the lora strength.
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
## Examples
<video controls src="https://huggingface.co./Cseti/Basic_camera_motion_LoRAs_sd15-ad2-v1/resolve/main/asset/LoRA-comparison-zoomin32.mp4" title="zoom in 32 frames"></video>
|