diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
| commit | 88485f6f05243e2fc459807b6644c1ff45a55d2e (patch) | |
| tree | a9b3f87b4ab31de3ec19e47de94c286a1682c8ae /results/cnn_baseline/state_bridge_s1024.json | |
| parent | 52b421fde3faa673e7007a456846f8195cb45942 (diff) | |
Recompute all CNN diagnostics with fixed BP gradient flow
CNN CIFAR-10 (5 seeds, fixed Gamma):
BP: acc=86.8%, Gamma=0.970, rho=0.603
DFA: acc=56.7%, Gamma=0.896, rho=0.061
EP: acc=50.6%, Gamma=0.484, rho=0.450
SB: acc=63.3%, Gamma=1.000 (BP self-cos, feedback nets not saved), rho=0.601
CB: acc=31.8%, Gamma=1.000 (BP self-cos), rho=0.226
DFA Gamma=0.896 is notably high — CNN DFA credit aligns well with BP gradients.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'results/cnn_baseline/state_bridge_s1024.json')
| -rw-r--r-- | results/cnn_baseline/state_bridge_s1024.json | 29 |
1 files changed, 12 insertions, 17 deletions
diff --git a/results/cnn_baseline/state_bridge_s1024.json b/results/cnn_baseline/state_bridge_s1024.json index fc24412..ab4ddc7 100644 --- a/results/cnn_baseline/state_bridge_s1024.json +++ b/results/cnn_baseline/state_bridge_s1024.json @@ -2,24 +2,19 @@ "method": "state_bridge", "seed": 1024, "acc": 0.6376, - "Gamma": 0.05339917540550232, - "rho": 0.30232751555740833, + "Gamma": 1.0, + "Gamma_note": "BP grad self-cosine (feedback nets not saved)", + "rho": 0.6108488440513611, "gammas_per_layer": [ - 0.0, - 0.0, - 0.0, - 0.21359670162200928 + 1.0, + 1.0, + 1.0, + 1.0 ], "rhos_per_layer": [ - 0.09910499304533005, - 0.08699683845043182, - 0.8239595890045166, - 0.19924864172935486 - ], - "epochs": 100, - "lr": 0.001, - "wd": 0.01, - "beta": 0.5, - "T_nudge": 20, - "alpha_nudge": 0.05 + 0.28591352701187134, + 0.160724937915802, + 0.9970240592956543, + 0.9997328519821167 + ] }
\ No newline at end of file |