diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 03:31:47 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 03:31:47 -0500 |
| commit | 6bb9eb645af3dcf8e122e82c5158b5cc10ca2253 (patch) | |
| tree | bb37f335bf01a9ee2bd615a2362cb6e27bd2e5ed /RESULTS.md | |
| parent | f9b462a37e9d941b7349e2e100cc3e6e5c076369 (diff) | |
results: close failed C2 local panel
Diffstat (limited to 'RESULTS.md')
| -rw-r--r-- | RESULTS.md | 28 |
1 files changed, 28 insertions, 0 deletions
@@ -298,6 +298,34 @@ also informative: d2 can optimize worse than d1, and d6 is less stable than d3/d therefore about a verified useful-depth pair, not monotonic improvement from adding arbitrary blocks. +## C2 local-rule panel (validation only) + +The next frozen panel crossed BP, FA, DFA, and no-traffic SDIL at d1/d4 over three task seeds and +five student seeds (120 runs). SDIL used the C3-selected `K=1/every=4` calibration schedule. All +runs came from clean revision `51301f6`, evaluated validation only after training, and computed +alignment and lesion diagnostics on the fixed training prefix. The independent synthetic test +sets remain unevaluated. + +| method | depth | validation acc (%) | d1-to-d4 gain | d4 lesion drop | +|:-------|------:|-------------------:|--------------:|---------------:| +| BP | 1 | 62.757 ± 8.111 | — | — | +| BP | 4 | 92.453 ± 8.834 | +29.697 | +30.157 | +| FA | 1 | 58.600 ± 4.839 | — | — | +| FA | 4 | 77.147 ± 16.082 | +18.547 | +16.853 | +| DFA | 1 | 55.517 ± 11.161 | — | — | +| DFA | 4 | 73.193 ± 13.987 | +17.677 | +22.650 | +| SDIL | 1 | 65.347 ± 6.516 | — | — | +| SDIL | 4 | 71.587 ± 15.307 | +6.240 | +12.787 | + +SDIL recovers only `21.0%` of BP's depth gain, versus `62.5%` for FA and `59.5%` for DFA, and its +d4 endpoint trails the stronger comparator by `5.560` points. Its final-third lesion reduces +accuracy in 11/15 runs, so the model often uses the late block even though its learned credit is +poor. **The C2 local validation gate fails and no test confirmation is allowed.** Additional +validation scratch found that K=4 or K=16 perturbations, more frequent events, larger `eta_A`, and +normalized local deltas do not remove the basin variability. This points to a representational +limitation of the fixed linear `A_l c` vectorizer: on a compositional target, the correct hidden +direction depends on neural state as well as the two-dimensional output error. + ## Paper-faithful non-backprop baselines `PETITE` in the initial request is treated as **PEPITA**. Implementations and hyperparameters were |
