WanAnimate generated video length issue

[Limuyi-col]

I've recently observed a discrepancy between the length of the generated video and the original video. For example, the original video is 6 seconds long with a total of 6 x 16 + 1 = 97 frames. I set frame_window_size to 81, meaning this task requires two windows. However, the generated video has 161 frames, indicating that the second window's output is also 81 frames, not the remaining frames. How can I resolve this issue?

[RuneGjerde]

did you set number of frames at num_frames in the WanVideo Embed node? (to 97 frames in your case)
Been a few since i used it, but think that should do it ;-)

(and leave frame_window_size to 77 or 81)

[Limuyi-col]

Yes, I set num_frames to the actual number of frames (97) in the input video and set frame_window_size to 81

[Limuyi-col]

I input any video that is longer than 5 seconds but shorter than 10 seconds, and the final generated video is always 10 seconds long.

[RuneGjerde]

Been a few since i used it, so i cant remember top of my head if that was supposed to be, padding.
But for now you could try set frame_window_size to the total frames as well.. both num_frames and frame_window_size to 97 in your case. And instead use WanVideo Context Option, and set that to 77 frames (or 81, although if i remember right, Wan Animate prefer 77).

If the padded frames is a feature or bug or limitation, i dont really know, and its been a few since I used it so i cant remember if it was always like that or not. Kijai or someone else might now ;-)

[RuneGjerde]

Actually i see now it says in the info box in the workflow

When using this method the window size stays constant, extra frames are generated in the case the last window is cut short.

So i guess thats how the node works. So you could try context window instead. Or just trim it shorter at the end.
Use an image batch node that can set the range to match your frames after video decode, and before video combine (save video).

If manually cutting out the extra frames it takes a little extra time (to create the extra frames), but perhaps not that long.

[Limuyi-col]

Thank you so much for your suggestion. Actually, the extra frames are in the middle of the video, not at the end.

I'll try using the WanVideo Context Option to see if that works.

[RuneGjerde]

Actually, the extra frames are in the middle of the video,

Ah yes, that sounds familiar. Not a simple end trim then ;-)

[Limuyi-col]

Use the WanVideo Context Option sovle my problem. However, the generated video will have flickering black shadows.

[kijai]

It definitely pads to the end, it's by design because we want the windows to be equal size. For something like 97 frames you could just disable windowing by setting window size to same as the total frames though, the model works ok up to 121 frames at least.

Or set window size to half of your total frames.

Or use context windows like you discovered, they have benefits but also can introduce other issues like consistency between windows, on the plus side the quality never degrades longer it goes.

[little6neko]

It definitely pads to the end, it's by design because we want the windows to be equal size. For something like 97 frames you could just disable windowing by setting window size to same as the total frames though, the model works ok up to 121 frames at least.

Or set window size to half of your total frames.

Or use context windows like you discovered, they have benefits but also can introduce other issues like consistency between windows, on the plus side the quality never degrades longer it goes.

Hello, I can successfully run four looping windows using “WanVideo Animate Embeds,” and the transitions between these windows are seamless. However, due to memory limitations, additional windows cannot be processed. Can “WanVideo Sampler” incorporate reference frames from the previously generated video during the first loop cycle, similar to the “continue_motion” feature in the official workflow?

[little6neko]

I attempted to modify the code myself and tested it, finding that it successfully maintains consistency.
#1840