<feed xmlns='http://www.w3.org/2005/Atom'>
<title>faeval.git/experiments/snapshot_time_sweep.py, branch master</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/'/>
<entry>
<title>Add Phase 7A: snapshot time sweep shows early snapshots have positive held-out transfer</title>
<updated>2026-03-25T15:23:19+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-03-25T15:23:19+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/faeval.git/commit/?id=ef5bd494087a46ee80d8bc17796074efdae81ff4'/>
<id>ef5bd494087a46ee80d8bc17796074efdae81ff4</id>
<content type='text'>
At epoch 5 (acc=49%), Vec_M4 5-step: dL_held=-0.005 (PUR=0.70)
  Oracle BP 5-step: dL_held=-0.009 (PUR=1.05)
  DFA 5-step: dL_held=+0.003 (always hurts held-out)

By epoch 20, generalization window closes. Held-out failure is late-snapshot artifact.
Better credit → lower update variance (Vec=0.8 vs DFA=40), not higher.

Key implication: DFA warmup delays credit bridge past its useful window.
Credit should be used from epoch 0, not after 20% warmup.

Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
At epoch 5 (acc=49%), Vec_M4 5-step: dL_held=-0.005 (PUR=0.70)
  Oracle BP 5-step: dL_held=-0.009 (PUR=1.05)
  DFA 5-step: dL_held=+0.003 (always hurts held-out)

By epoch 20, generalization window closes. Held-out failure is late-snapshot artifact.
Better credit → lower update variance (Vec=0.8 vs DFA=40), not higher.

Key implication: DFA warmup delays credit bridge past its useful window.
Credit should be used from epoch 0, not after 20% warmup.

Co-Authored-By: Claude Opus 4.6 (1M context) &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
</feed>
