Skip to content

[Non Record] Attention Warm-Start: Initializing Q/K from Bigram Co-occurrence SVD#678

Open
SPThole wants to merge 7 commits intoopenai:mainfrom
SPThole:non_record_1
Open

[Non Record] Attention Warm-Start: Initializing Q/K from Bigram Co-occurrence SVD#678
SPThole wants to merge 7 commits intoopenai:mainfrom
SPThole:non_record_1

Commits

Commits on Mar 24, 2026

Commits on Mar 25, 2026