Can't get motion lora to work with AnimateDiff v3

#1
by pellaaa - opened

Hello I am trying to use your motion lora with AD v3 (comfyui AnimateDiff evolved, last version), specifically I am trying to use drone forward lora for the zoom-in effect but it produce zero effect also with high strength, I am loading it with animatediff lora node, any idea? am I missing something? resolution is 896 x 512 (I know is not the one suggested but it should still produce some motion because v2 loras are perfectly working with v2 model) thank you

Owner

Hi, unfortunately v2 loras won't work with v3 models.

Yes I know that but haven't you upload a v3 version? I thought they were for v3!

Owner

No, the drone forward loras are only for v2. Check the file summary section "compatible motion model" column. Maybe I'll also rename the files to make it more self-explanatory.
I did not train it with v3 as I'm so satisfied with AnimateLCM I thought there is not reason to train with v3 anymore :)

I see.. well I am not a real fan of lcm, lighting, turbo etc can I ask how it is animatelcm compared to animatediff v3 in terms of quality? also are there any motion lora for animatelcm?
edit: I readnow that v2 lora are combatible with lcm version so i assume that's the quality level, quite weak compared to v3 if is same of v2

Owner

Well, AnimateLCM is a motion model that was trained on the v2 model. All motion LORAs that are compatible with v2 motion model are compatible with AnimateLCM also. I think it works quite well with characters. Need some special settings tho. I also don't like the general image LCM LORA, but together with AnimateLCM, much better results can be achieved. For me, the increase in speed provided by AnimateLCM outweighs the decrease of the quality. I don't know about any comparison maybe worth googling it, but I can show you two examples I made recently with AnimateLCM.
https://youtu.be/42ygriK7Y4s?si=_kisIdYjDYcIY5N5
https://youtu.be/uqc4HUVlPLw?si=W-M1pv1rx0ZY-xly

Cseti changed discussion status to closed

Sign up or log in to comment