diff options
| author | Yuren Hao <yurenh2@illinois.edu> | 2026-07-05 05:09:36 -0500 |
|---|---|---|
| committer | Yuren Hao <yurenh2@illinois.edu> | 2026-07-05 05:09:36 -0500 |
| commit | 75ff326dcb40cd960abd56e9c9c18a45d9e5e2c2 (patch) | |
| tree | 575cbed6adc41c845685c7286437c4620f040cdb /ep_run/train_recon.py | |
| parent | cbecb171b1af77fe6510fd60f1dfa4c7938a20d6 (diff) | |
--sdpa: fused flash attention in the no_grad relax loop — 1.45x free phase, z* parity 4e-7
Scoped via blk._sdpa set only inside relax()'s loop (grad paths jvp/vjp/resreg
keep the manual attention: no forward-mode-through-flash risk). Combined with
--holofast: ~1.51x full-step exact-math tier.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'ep_run/train_recon.py')
0 files changed, 0 insertions, 0 deletions