<feed xmlns='http://www.w3.org/2005/Atom'>
<title>faeval.git/experiments/ep_baseline.py, branch master</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/'/>
<entry>
<title>Round 36: upgrade (b) wording + add EP random-target neg control to §3</title>
<updated>2026-04-08T11:11:25+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-04-08T11:11:25+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/commit/?id=02c3d2c80805daedb2b6c8e9d6e5f36c52d361a1'/>
<id>02c3d2c80805daedb2b6c8e9d6e5f36c52d361a1</id>
<content type='text'>
Two changes from round 36:
1. §3 paragraph 3: replace 'observational association' with full causal claim
   based on existing April 7 no-out_ln data (3 seeds, ResMLP-d256+terminal-LN
   removed, residual skip kept): ||h_L||=1.21e7 (Mode 1 (a) still fires) but
   ||g_L||=7.4e-4 (HEALTHY, ~10000x above floor — (b) eliminated). Final acc
   0.327±0.013 indistinguishable from vanilla DFA's 0.308±0.014. Wording
   upgraded to 'terminal LayerNorm is necessary for Mode 1(b) in the audited
   residual ResMLP and ViT-Mini setting'.

2. §3 paragraph after random-target ablation: add EP under random targets
   smoke result (||h_L||=586 at ep 5 vs DFA's 14510 at ep 3, 25x gap).
   Random-target assay now cleanly separates fixed-feedback methods (explode)
   from EP (bounded). Cross-method negative control complete.

- experiments/ep_baseline.py: add --random_targets flag + train_ep parameter
- v2.5 paper compiles to 15 pages, main content 1-9 (right at E&amp;D limit)

Combined picture (rounds 32-36):
- Mode 1 (a) localized to 'fixed-feedback local-credit objectives without
  scale control on architectures absorbing scale at output'. Falsified:
  residual skip (round 33), task signal (round 34), DFA-specific (round 35).
  EP is the working negative control (round 36).
- Mode 1 (b) localized to terminal LayerNorm via the 1/||h|| Jacobian.
  Causally established by April 7 no_outln 3-seed data.

Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Two changes from round 36:
1. §3 paragraph 3: replace 'observational association' with full causal claim
   based on existing April 7 no-out_ln data (3 seeds, ResMLP-d256+terminal-LN
   removed, residual skip kept): ||h_L||=1.21e7 (Mode 1 (a) still fires) but
   ||g_L||=7.4e-4 (HEALTHY, ~10000x above floor — (b) eliminated). Final acc
   0.327±0.013 indistinguishable from vanilla DFA's 0.308±0.014. Wording
   upgraded to 'terminal LayerNorm is necessary for Mode 1(b) in the audited
   residual ResMLP and ViT-Mini setting'.

2. §3 paragraph after random-target ablation: add EP under random targets
   smoke result (||h_L||=586 at ep 5 vs DFA's 14510 at ep 3, 25x gap).
   Random-target assay now cleanly separates fixed-feedback methods (explode)
   from EP (bounded). Cross-method negative control complete.

- experiments/ep_baseline.py: add --random_targets flag + train_ep parameter
- v2.5 paper compiles to 15 pages, main content 1-9 (right at E&amp;D limit)

Combined picture (rounds 32-36):
- Mode 1 (a) localized to 'fixed-feedback local-credit objectives without
  scale control on architectures absorbing scale at output'. Falsified:
  residual skip (round 33), task signal (round 34), DFA-specific (round 35).
  EP is the working negative control (round 36).
- Mode 1 (b) localized to terminal LayerNorm via the 1/||h|| Jacobian.
  Causally established by April 7 no_outln 3-seed data.

Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Fix EP credit sign: negate (h_nudge - h_free)/β to align with BP grad direction</title>
<updated>2026-04-03T04:34:12+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-04-03T04:34:12+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/commit/?id=2aaabd9a95386bf9f274cb9907ac6a5306171759'/>
<id>2aaabd9a95386bf9f274cb9907ac6a5306171759</id>
<content type='text'>
EP nudge moves h toward lower loss (opposite to BP grad which points toward loss increase).
Without negation, Gamma is negative and rho is -0.25.

Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
EP nudge moves h toward lower loss (opposite to BP grad which points toward loss increase).
Without negation, Gamma is negative and rho is -0.25.

Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Add --d_hidden arg to ep_baseline.py for d=512 support</title>
<updated>2026-04-03T02:15:35+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-04-03T02:15:35+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/commit/?id=6a47ae80aeed672f24b8ceb12f79f92d86a6bb2f'/>
<id>6a47ae80aeed672f24b8ceb12f79f92d86a6bb2f</id>
<content type='text'>
Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Add EP baseline implementation (Scellier &amp; Bengio 2017) for CIFAR MLP</title>
<updated>2026-04-02T16:22:48+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-04-02T16:22:48+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/commit/?id=61204b6010e403b4c61b093f2a208a881b20fa11'/>
<id>61204b6010e403b4c61b093f2a208a881b20fa11</id>
<content type='text'>
Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
</feed>
