diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
| commit | 88485f6f05243e2fc459807b6644c1ff45a55d2e (patch) | |
| tree | a9b3f87b4ab31de3ec19e47de94c286a1682c8ae /results/cnn_baseline/dfa_s456.json | |
| parent | 52b421fde3faa673e7007a456846f8195cb45942 (diff) | |
Recompute all CNN diagnostics with fixed BP gradient flow
CNN CIFAR-10 (5 seeds, fixed Gamma):
BP: acc=86.8%, Gamma=0.970, rho=0.603
DFA: acc=56.7%, Gamma=0.896, rho=0.061
EP: acc=50.6%, Gamma=0.484, rho=0.450
SB: acc=63.3%, Gamma=1.000 (BP self-cos, feedback nets not saved), rho=0.601
CB: acc=31.8%, Gamma=1.000 (BP self-cos), rho=0.226
DFA Gamma=0.896 is notably high — CNN DFA credit aligns well with BP gradients.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'results/cnn_baseline/dfa_s456.json')
| -rw-r--r-- | results/cnn_baseline/dfa_s456.json | 26 |
1 files changed, 10 insertions, 16 deletions
diff --git a/results/cnn_baseline/dfa_s456.json b/results/cnn_baseline/dfa_s456.json index 30de9b1..3ea0549 100644 --- a/results/cnn_baseline/dfa_s456.json +++ b/results/cnn_baseline/dfa_s456.json @@ -2,24 +2,18 @@ "method": "dfa", "seed": 456, "acc": 0.5954, - "Gamma": 0.2133052498102188, - "rho": 0.01581542007625103, + "Gamma": 0.8969991058111191, + "rho": 0.03725381940603256, "gammas_per_layer": [ - 0.0, - 0.0, - 0.0, + 0.9343998432159424, + 0.9098192453384399, + 0.8905563354492188, 0.8532209992408752 ], "rhos_per_layer": [ - 0.0, - 0.0, - 0.0, - 0.06326168030500412 - ], - "epochs": 100, - "lr": 0.001, - "wd": 0.01, - "beta": 0.5, - "T_nudge": 20, - "alpha_nudge": 0.05 + 0.0022673271596431732, + 0.015258125960826874, + 0.055126916617155075, + 0.07636290788650513 + ] }
\ No newline at end of file |