summaryrefslogtreecommitdiff
path: root/RESULTS.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 03:59:52 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 03:59:52 -0500
commit7eb40a516849cbc3e93540d4fdf40366f6a8df9e (patch)
tree36fac2cf85fbc94e3d5eef8fcbc082bb5af839ed /RESULTS.md
parent22eac0aa7c98c4caa4b768a45a53b7d2fb4b1521 (diff)
results: close context-vectorizer C2 recovery
Diffstat (limited to 'RESULTS.md')
-rw-r--r--RESULTS.md28
1 files changed, 28 insertions, 0 deletions
diff --git a/RESULTS.md b/RESULTS.md
index 5e7e4fe..0661b42 100644
--- a/RESULTS.md
+++ b/RESULTS.md
@@ -326,6 +326,34 @@ normalized local deltas do not remove the basin variability. This points to a re
limitation of the fixed linear `A_l c` vectorizer: on a compositional target, the correct hidden
direction depends on neural state as well as the two-dimensional output error.
+## C2 bounded context-vectorizer recovery (validation only)
+
+To test the identified representation bottleneck, the apical vectorizer was extended to
+`A_l c + G_l vec(c outer tanh(h_top))`. The gated path is zero-initialized, trained by the same
+local perturbation regression, and vanishes in neutral periods. After a task-seed-0 development
+screen selected `eta_A=0.01`, K1/e4, an independent frozen panel used new task seeds 3--5 and five
+student seeds, again crossing BP, FA, DFA, and SDIL at d1/d4. All 120 runs came from clean revision
+`b18227f`; independent test sets were never evaluated.
+
+| method | depth | validation acc (%) | d1-to-d4 gain | d4 lesion drop |
+|:-------|------:|-------------------:|--------------:|---------------:|
+| BP | 1 | 68.633 ± 5.351 | — | — |
+| BP | 4 | 97.187 ± 1.532 | +28.553 | +34.170 |
+| FA | 1 | 52.640 ± 4.528 | — | — |
+| FA | 4 | 80.763 ± 20.592 | +28.123 | +20.313 |
+| DFA | 1 | 56.313 ± 8.374 | — | — |
+| DFA | 4 | 77.097 ± 17.667 | +20.783 | +25.393 |
+| context-SDIL | 1 | 63.977 ± 8.636 | — | — |
+| context-SDIL | 4 | 79.120 ± 22.765 | +15.143 | +27.150 |
+
+Context conditioning raises SDIL's recovery of BP depth gain from the linear panel's `21.0%` to
+`53.0%`, confirming that state dependence was a real bottleneck. It is still below the frozen
+70% requirement, while FA recovers `98.5%`; context-SDIL's d4 mean is `1.643` points below FA.
+Exactly 10/15 SDIL pairs gain with depth and 10/15 are hurt by the lesion, but one d4 run ends with
+nonfinite loss and chance accuracy. **The independent recovery gate fails and C2 test remains
+prohibited.** A richer vectorizer can improve mean credit without curing coupled A/W basin
+instability; this is now a documented limitation rather than an oral-level scaling result.
+
## Paper-faithful non-backprop baselines
`PETITE` in the initial request is treated as **PEPITA**. Implementations and hyperparameters were