<feed xmlns='http://www.w3.org/2005/Atom'>
<title>ept.git/ep_run/sdpa_gate.py, branch xiang</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/ept.git/'/>
<entry>
<title>--sdpa: fused flash attention in the no_grad relax loop — 1.45x free phase, z* parity 4e-7</title>
<updated>2026-07-05T10:09:36+00:00</updated>
<author>
<name>Yuren Hao</name>
<email>yurenh2@illinois.edu</email>
</author>
<published>2026-07-05T10:09:36+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/ept.git/commit/?id=75ff326dcb40cd960abd56e9c9c18a45d9e5e2c2'/>
<id>75ff326dcb40cd960abd56e9c9c18a45d9e5e2c2</id>
<content type='text'>
Scoped via blk._sdpa set only inside relax()'s loop (grad paths jvp/vjp/resreg
keep the manual attention: no forward-mode-through-flash risk). Combined with
--holofast: ~1.51x full-step exact-math tier.

Co-Authored-By: Claude Fable 5 &lt;noreply@anthropic.com&gt;
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Scoped via blk._sdpa set only inside relax()'s loop (grad paths jvp/vjp/resreg
keep the manual attention: no forward-mode-through-flash risk). Combined with
--holofast: ~1.51x full-step exact-math tier.

Co-Authored-By: Claude Fable 5 &lt;noreply@anthropic.com&gt;
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
</pre>
</div>
</content>
</entry>
</feed>
