summaryrefslogtreecommitdiff
path: root/RESULTS.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 03:18:54 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 03:18:54 -0500
commit5789cf1358542a3216761e578d5d87e021dec35c (patch)
tree98cce6049a1b87609923e89bf60376b475068184 /RESULTS.md
parent9c9da14974da85c4f06853a7da882601af6963c5 (diff)
results: mark useful-depth BP screen passed
Diffstat (limited to 'RESULTS.md')
-rw-r--r--RESULTS.md22
1 files changed, 22 insertions, 0 deletions
diff --git a/RESULTS.md b/RESULTS.md
index 14c9f2b..d98e89d 100644
--- a/RESULTS.md
+++ b/RESULTS.md
@@ -276,6 +276,28 @@ DFA's teaching signal to early/deep layers collapses toward random (~0.05–0.19
SDIL stays ~0.85 and is depth-invariant. This is the "does credit reach early layers" metric that
DFA fails and SDIL passes — the core advantage.
+## C2 BP useful-depth screen (validation only)
+
+The frozen candidate uses a two-level Telgarsky tent-map task, width-8 ReLU residual networks,
+and three independently generated task/data seeds. Student initialization is fixed at seed 0 for
+this shape screen. All 15 runs came from clean revision `76688af`, used stratified validation
+subsets drawn only from generated training data, and never evaluated the independent test sets.
+
+| depth | validation acc (%) | task-seed endpoints (%) | final-third lesion drops (points) |
+|------:|-------------------:|:------------------------|:---------------------------------|
+| 1 | 63.933 ± 10.272 | 75.25, 55.20, 61.35 | — |
+| 2 | 60.883 ± 7.243 | 57.85, 69.15, 55.65 | +14.25, +24.75, +15.10 |
+| 3 | 97.250 ± 1.097 | 96.30, 97.00, 98.45 | +58.80, +58.75, +60.15 |
+| 4 | 96.883 ± 1.457 | 97.35, 98.05, 95.25 | +40.85, +35.05, +34.85 |
+| 6 | 90.733 ± 7.743 | 96.35, 93.95, 81.90 | +40.05, +40.35, -2.10 |
+
+For the preselected d1-to-d4 comparison, paired BP gains are `+22.10`, `+42.85`, and `+33.90`
+points (mean `+32.95`). The corresponding final-third lesion drops average `36.92` points and are
+positive for every task seed. **The BP useful-depth sub-gate passes.** The nonmonotonic curve is
+also informative: d2 can optimize worse than d1, and d6 is less stable than d3/d4. The claim is
+therefore about a verified useful-depth pair, not monotonic improvement from adding arbitrary
+blocks.
+
## Paper-faithful non-backprop baselines
`PETITE` in the initial request is treated as **PEPITA**. Implementations and hyperparameters were