summaryrefslogtreecommitdiff
path: root/ep_run/sdpa_gate.py
AgeCommit message (Collapse)Author
2026-07-05--sdpa: fused flash attention in the no_grad relax loop — 1.45x free ↵Yuren Hao
phase, z* parity 4e-7 Scoped via blk._sdpa set only inside relax()'s loop (grad paths jvp/vjp/resreg keep the manual attention: no forward-mode-through-flash risk). Combined with --holofast: ~1.51x full-step exact-math tier. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn