diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-08 06:37:23 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-08 06:37:23 -0500 |
| commit | b4d276f6a4b20c7766e0bceb687e42ecd4869fef (patch) | |
| tree | 8f5452bb6e38174a519abb2168541d31c6a45604 /experiments/local_update_swap.py | |
| parent | afc2821acceb11d50b74d68584b1bf8378adc9c7 (diff) | |
Round 38: add --penalty_lam flag to cifar_resmlp.py for Mode 2 cross-method test
Patches:
- main(): add --penalty_lam (separate from CB's bridge temperature args.lam)
- train_dfa block update (line 195): add penalty_lam * (f_l**2).sum(-1).mean()
- train_state_bridge block update (line 326): same penalty
- train_credit_bridge block update (line 533): same penalty
Codex round 38 GO STAGE: keep penalty separate from CB lam, blocks-only,
sanity-check that hidden_norms remain nontrivial (not silencing the blocks).
2-epoch smoke (results/round38_smoke_sbcb_pen) passes the silencing check:
SB ||h_L||=229, CB ||h_L||=1258, both nontrivial. Deep cosines positive across
all layers for SB ([0.28, 0.25, 0.23]) and rising for CB ([0.04, 0.08, 0.13, 0.15]).
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'experiments/local_update_swap.py')
0 files changed, 0 insertions, 0 deletions
