diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-08 01:44:29 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-08 01:44:29 -0500 |
| commit | 032afbfc3ec3961748cc557f428d2fd6e4eda5d9 (patch) | |
| tree | 6c48b7ae53cb4db99046a64de0cd1fe7cf72185b /results/confirmatory/d512_sparsity/bp_s42.json | |
| parent | f92ebda7ec2ac155c1a4241b057801c863834e56 (diff) | |
BP+penalty control result: mode 2 (intrinsic credit quality) confirmed REAL
BP + lam=1e-2 ||f||^2 penalty trained for 30 epochs (s42):
ep 30 final: test_acc 0.5303
margin vs DFA-shallow 0.349: +18.13 pp
The 2x2 accuracy grid:
no penalty with penalty
BP 0.609 0.530
DFA 0.308 0.363
Penalty effect on BP: -8 pp (capacity regularization cost)
Penalty effect on DFA: +5.5 pp (rescue from active harm)
Mode 2 (intrinsic credit quality) is confirmed REAL by this control:
even after the penalty's capacity cost, BP achieves +18 pp depth
utilization. DFA under the same penalty achieves only +1.4 pp. The
difference (~17 pp) cannot be attributed to capacity loss — it is
genuine credit-quality cost of random feedback vs true backprop
gradient.
This validates the round 19 'two distinct failure modes' framing:
mode 2 is not a penalty-induced regularization artifact.
Diffstat (limited to 'results/confirmatory/d512_sparsity/bp_s42.json')
0 files changed, 0 insertions, 0 deletions
