Skip to content

Conversation

@vasqu
Copy link
Contributor

@vasqu vasqu commented Nov 26, 2025

Fixes #42405
#42404 has a lot of unnecessary things alongside it, this aims to supersede it

Remaining TODOs:

  • Equivalence tests to fa3 (need to compile from source again 😢 ..in progress)
  • Sanity check if the usage of partial destroys compile support for older fa versions
  • Handle FA2 detection as it clashes with FA4 atm
  • Refactor modeling utils? A lot of duplicated messages

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@github-actions
Copy link
Contributor

[For maintainers] Suggested jobs to run (before merge)

run-slow: edgetam, gemma3, modernbert, sam2, sam3, sam3_tracker

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Integrate FA4 (Flash Attention for Blackwell) into HF Transformers

2 participants