summaryrefslogtreecommitdiff
path: root/RESULTS.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 03:31:47 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 03:31:47 -0500
commit6bb9eb645af3dcf8e122e82c5158b5cc10ca2253 (patch)
treebb37f335bf01a9ee2bd615a2362cb6e27bd2e5ed /RESULTS.md
parentf9b462a37e9d941b7349e2e100cc3e6e5c076369 (diff)
results: close failed C2 local panel
Diffstat (limited to 'RESULTS.md')
-rw-r--r--RESULTS.md28
1 files changed, 28 insertions, 0 deletions
diff --git a/RESULTS.md b/RESULTS.md
index d98e89d..5e7e4fe 100644
--- a/RESULTS.md
+++ b/RESULTS.md
@@ -298,6 +298,34 @@ also informative: d2 can optimize worse than d1, and d6 is less stable than d3/d
therefore about a verified useful-depth pair, not monotonic improvement from adding arbitrary
blocks.
+## C2 local-rule panel (validation only)
+
+The next frozen panel crossed BP, FA, DFA, and no-traffic SDIL at d1/d4 over three task seeds and
+five student seeds (120 runs). SDIL used the C3-selected `K=1/every=4` calibration schedule. All
+runs came from clean revision `51301f6`, evaluated validation only after training, and computed
+alignment and lesion diagnostics on the fixed training prefix. The independent synthetic test
+sets remain unevaluated.
+
+| method | depth | validation acc (%) | d1-to-d4 gain | d4 lesion drop |
+|:-------|------:|-------------------:|--------------:|---------------:|
+| BP | 1 | 62.757 ± 8.111 | — | — |
+| BP | 4 | 92.453 ± 8.834 | +29.697 | +30.157 |
+| FA | 1 | 58.600 ± 4.839 | — | — |
+| FA | 4 | 77.147 ± 16.082 | +18.547 | +16.853 |
+| DFA | 1 | 55.517 ± 11.161 | — | — |
+| DFA | 4 | 73.193 ± 13.987 | +17.677 | +22.650 |
+| SDIL | 1 | 65.347 ± 6.516 | — | — |
+| SDIL | 4 | 71.587 ± 15.307 | +6.240 | +12.787 |
+
+SDIL recovers only `21.0%` of BP's depth gain, versus `62.5%` for FA and `59.5%` for DFA, and its
+d4 endpoint trails the stronger comparator by `5.560` points. Its final-third lesion reduces
+accuracy in 11/15 runs, so the model often uses the late block even though its learned credit is
+poor. **The C2 local validation gate fails and no test confirmation is allowed.** Additional
+validation scratch found that K=4 or K=16 perturbations, more frequent events, larger `eta_A`, and
+normalized local deltas do not remove the basin variability. This points to a representational
+limitation of the fixed linear `A_l c` vectorizer: on a compositional target, the correct hidden
+direction depends on neural state as well as the two-dimensional output error.
+
## Paper-faithful non-backprop baselines
`PETITE` in the initial request is treated as **PEPITA**. Implementations and hyperparameters were