diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-08 09:22:52 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-08 09:22:52 -0500 |
| commit | 8c661528e3f770e69d7a126fff95ca781f07fd87 (patch) | |
| tree | 15d7688f03f95d7d2d9b4ce7475f9afaa6b73269 /results/dfa_pen_short/dfa_pen_lam0.1_s42.json | |
| parent | 0dc89449af7307516372fe2b0463c11484a695e1 (diff) | |
Round 38 CB+penalty multi-seed: confirm clean cos-vs-acc dissociation across 3 fixed-feedback methods
CB+penalty 3-seed (4-block d=256, 30ep, lam=1e-2):
- acc 0.360±0.003 (same as DFA+pen, 9pp below SB+pen)
- ||h_L||=5680±178, ||g_L||=1.9e-5 (HEALTHY)
- layer-0 cos +0.652±0.005
- deep cos +0.679±0.008 (4x DFA+pen, 2x SB+pen)
- deep rho +0.464±0.025 (6x DFA+pen)
Final 3-method rescue comparison:
DFA+pen: acc 0.363, deep cos 0.155, deep rho 0.080
SB+pen: acc 0.453, deep cos 0.322, deep rho 0.402
CB+pen: acc 0.360, deep cos 0.679, deep rho 0.464
Clean cos-vs-acc dissociation:
- CB has 4x higher deep cos than DFA but SAME accuracy
- SB has intermediate deep cos but HIGHEST accuracy
- Alignment to BP gradient is NECESSARY but NOT SUFFICIENT for usable credit
Paper updates:
- §4 ¶4: now includes all 3 methods with numbers, adds 'cos is necessary but not
sufficient' framing based on 3-method dissociation
- Appendix K: adds CB+pen 3-seed rows + vanilla CB baseline for comparison
- Main content still 9 pages exactly (within E&D limit)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'results/dfa_pen_short/dfa_pen_lam0.1_s42.json')
0 files changed, 0 insertions, 0 deletions
