Issue with query reshaping (RuntimeError)

[youngyoon911]

RuntimeError: shape '[80, -1, 8, 40]' is invalid for input of size 20971520

Because of this setting, transformer input's (hidden state) batch size turns into 16, but text embedding's (encoder_hidden_state) batch size remains 80, then causes that error.

How can I fix it?

Thanks!

[LiGengWan]

I have the same issue. Have you found a solution?

[Arlaz]

These lines :

pipe.enable_free_noise(
    context_length=16,
    context_stride=12,
)
pipe.enable_free_noise_split_inference(
    temporal_split_size=16,
    spatial_split_size=256
)
pipe.unet.enable_forward_chunking(16)

are only for generating longer video with freenoise, if you only intend to generate a 16 frame long vid you can remove them, otherwise, as diffusers does not permit free noise compatibility with AnimateDiff, you need to use our diffusers fork here : https://github.com/obvious-research/diffusers.git