why version of flash_attn is 2.3.4? seems too low for common use.

[jamestang0219]

no more info.

[wusize]

Hi, you can also try newer versions. And remember to upgrade your transformers, too.

[jamestang0219]

Hi, you can also try newer versions. And remember to upgrade your transformers, too.

need to modify bert_padding module if using higher version flash_attn