diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
| commit | 88485f6f05243e2fc459807b6644c1ff45a55d2e (patch) | |
| tree | a9b3f87b4ab31de3ec19e47de94c286a1682c8ae /results/cnn_baseline/dfa_s42.json | |
| parent | 52b421fde3faa673e7007a456846f8195cb45942 (diff) | |
Recompute all CNN diagnostics with fixed BP gradient flow
CNN CIFAR-10 (5 seeds, fixed Gamma):
BP: acc=86.8%, Gamma=0.970, rho=0.603
DFA: acc=56.7%, Gamma=0.896, rho=0.061
EP: acc=50.6%, Gamma=0.484, rho=0.450
SB: acc=63.3%, Gamma=1.000 (BP self-cos, feedback nets not saved), rho=0.601
CB: acc=31.8%, Gamma=1.000 (BP self-cos), rho=0.226
DFA Gamma=0.896 is notably high — CNN DFA credit aligns well with BP gradients.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'results/cnn_baseline/dfa_s42.json')
| -rw-r--r-- | results/cnn_baseline/dfa_s42.json | 26 |
1 files changed, 10 insertions, 16 deletions
diff --git a/results/cnn_baseline/dfa_s42.json b/results/cnn_baseline/dfa_s42.json index dbc1099..348bb10 100644 --- a/results/cnn_baseline/dfa_s42.json +++ b/results/cnn_baseline/dfa_s42.json @@ -2,24 +2,18 @@ "method": "dfa", "seed": 42, "acc": 0.5527, - "Gamma": 0.22270919382572174, - "rho": 0.011658251285552979, + "Gamma": 0.9160496741533279, + "rho": 0.07099265232682228, "gammas_per_layer": [ - 0.0, - 0.0, - 0.0, + 0.9313884973526001, + 0.9255707859992981, + 0.9164026379585266, 0.890836775302887 ], "rhos_per_layer": [ - 0.0, - 0.0, - 0.0, - 0.046633005142211914 - ], - "epochs": 100, - "lr": 0.001, - "wd": 0.01, - "beta": 0.5, - "T_nudge": 20, - "alpha_nudge": 0.05 + 0.056976765394210815, + 0.05616474151611328, + 0.07875743508338928, + 0.09207166731357574 + ] }
\ No newline at end of file |