diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-03-26 16:27:53 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-03-26 16:27:53 -0500 |
| commit | 610e1169e19378cccd2d9b92a588c24dca7f3df7 (patch) | |
| tree | 532f8dc2fda6c68ab1409b20d7431b76d8d6f378 /report_explore/MEMO_frozen_cifar_recovery.md | |
| parent | ef4aed70130e2212b4ed1cb7212e2ea6c7c7adb2 (diff) | |
Add Phase 10A.5: blend gain is implicit regularization, not learned credit
Dissection of 6 branches from same DFA checkpoint:
- blend_random_frozen: 12.6% (CATASTROPHIC — frozen noise destroys training)
- blend_random_trainable: 32.2% (+1.2% — trainable network helps)
- blend_shuffled_trainable: 32.5% (+1.4% — even wrong targets work!)
- blend_gaussian_noise: 30.8% (neutral)
- scaled_DFA_norm_match: 31.0% (neutral)
The gain comes from implicit regularization through a co-optimized auxiliary
network, NOT from learned credit quality. Phase 9A's +1.5% was an optimization
dynamics effect, not evidence of useful credit assignment.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'report_explore/MEMO_frozen_cifar_recovery.md')
0 files changed, 0 insertions, 0 deletions
