diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-03 17:35:12 -0500 |
| commit | 88485f6f05243e2fc459807b6644c1ff45a55d2e (patch) | |
| tree | a9b3f87b4ab31de3ec19e47de94c286a1682c8ae /results/cnn_baseline/dfa_s1024.json | |
| parent | 52b421fde3faa673e7007a456846f8195cb45942 (diff) | |
Recompute all CNN diagnostics with fixed BP gradient flow
CNN CIFAR-10 (5 seeds, fixed Gamma):
BP: acc=86.8%, Gamma=0.970, rho=0.603
DFA: acc=56.7%, Gamma=0.896, rho=0.061
EP: acc=50.6%, Gamma=0.484, rho=0.450
SB: acc=63.3%, Gamma=1.000 (BP self-cos, feedback nets not saved), rho=0.601
CB: acc=31.8%, Gamma=1.000 (BP self-cos), rho=0.226
DFA Gamma=0.896 is notably high — CNN DFA credit aligns well with BP gradients.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'results/cnn_baseline/dfa_s1024.json')
| -rw-r--r-- | results/cnn_baseline/dfa_s1024.json | 26 |
1 files changed, 10 insertions, 16 deletions
diff --git a/results/cnn_baseline/dfa_s1024.json b/results/cnn_baseline/dfa_s1024.json index 64755e1..5d7a344 100644 --- a/results/cnn_baseline/dfa_s1024.json +++ b/results/cnn_baseline/dfa_s1024.json @@ -2,24 +2,18 @@ "method": "dfa", "seed": 1024, "acc": 0.5868, - "Gamma": 0.22504013776779175, - "rho": 0.01557417493313551, + "Gamma": 0.9268007129430771, + "rho": 0.05462135933339596, "gammas_per_layer": [ - 0.0, - 0.0, - 0.0, + 0.9555332064628601, + 0.9357756972312927, + 0.9157333970069885, 0.900160551071167 ], "rhos_per_layer": [ - 0.0, - 0.0, - 0.0, - 0.06229669973254204 - ], - "epochs": 100, - "lr": 0.001, - "wd": 0.01, - "beta": 0.5, - "T_nudge": 20, - "alpha_nudge": 0.05 + 0.11999575793743134, + -0.026779158040881157, + 0.028735635802149773, + 0.09653320163488388 + ] }
\ No newline at end of file |