diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
| commit | 88485f6f05243e2fc459807b6644c1ff45a55d2e (patch) | |
| tree | a9b3f87b4ab31de3ec19e47de94c286a1682c8ae /results/cnn_baseline/dfa_s789.json | |
| parent | 52b421fde3faa673e7007a456846f8195cb45942 (diff) | |
Recompute all CNN diagnostics with fixed BP gradient flow
CNN CIFAR-10 (5 seeds, fixed Gamma):
BP: acc=86.8%, Gamma=0.970, rho=0.603
DFA: acc=56.7%, Gamma=0.896, rho=0.061
EP: acc=50.6%, Gamma=0.484, rho=0.450
SB: acc=63.3%, Gamma=1.000 (BP self-cos, feedback nets not saved), rho=0.601
CB: acc=31.8%, Gamma=1.000 (BP self-cos), rho=0.226
DFA Gamma=0.896 is notably high — CNN DFA credit aligns well with BP gradients.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'results/cnn_baseline/dfa_s789.json')
| -rw-r--r-- | results/cnn_baseline/dfa_s789.json | 26 |
1 files changed, 10 insertions, 16 deletions
diff --git a/results/cnn_baseline/dfa_s789.json b/results/cnn_baseline/dfa_s789.json index 5c030df..ddf65ea 100644 --- a/results/cnn_baseline/dfa_s789.json +++ b/results/cnn_baseline/dfa_s789.json @@ -2,24 +2,18 @@ "method": "dfa", "seed": 789, "acc": 0.5481, - "Gamma": 0.20736519992351532, - "rho": 0.01041002944111824, + "Gamma": 0.8707475662231445, + "rho": 0.042915886268019676, "gammas_per_layer": [ - 0.0, - 0.0, - 0.0, + 0.9151090979576111, + 0.8799393177032471, + 0.8584810495376587, 0.8294607996940613 ], "rhos_per_layer": [ - 0.0, - 0.0, - 0.0, - 0.04164011776447296 - ], - "epochs": 100, - "lr": 0.001, - "wd": 0.01, - "beta": 0.5, - "T_nudge": 20, - "alpha_nudge": 0.05 + 0.048544302582740784, + 0.010241687297821045, + 0.07223255932331085, + 0.040644995868206024 + ] }
\ No newline at end of file |