summaryrefslogtreecommitdiff
path: root/ROADMAP.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 04:51:49 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 04:51:49 -0500
commitd344f7fa4b8a6b907d364d1900348ca8e4b709ce (patch)
tree13fcf933e308c918c8047aa343787a662044e962 /ROADMAP.md
parente8d698e9da1e2441d1d137eb8f8ab6cd46b4282c (diff)
results: confirm C2 feedback amortization bottleneck
Diffstat (limited to 'ROADMAP.md')
-rw-r--r--ROADMAP.md24
1 files changed, 24 insertions, 0 deletions
diff --git a/ROADMAP.md b/ROADMAP.md
index 256c8fe..9a6f46f 100644
--- a/ROADMAP.md
+++ b/ROADMAP.md
@@ -148,6 +148,30 @@ secondary conditions passed at the boundary. Context conditioning improves subst
linear SDIL's 21.0% recovery but does not make causal-feedback learning reliable enough. The
predeclared mechanism-recovery branch is closed and no C2 test panel will run.
+The follow-up causal diagnosis replaces the learned vectorizer with direct layerwise antithetic
+node-perturbation targets on every update. Task seed 0 and model seeds 0--2 were development-only:
+an estimator/LR screen selected `eta=0.03`, and a predeclared smaller-K-within-one-point rule chose
+K16 over K4. The frozen diagnosis then used task seeds 3--5, model seeds 0--4, d1/d4, the same
+training-only validation splits, and no intermediate held-out metrics. It diagnoses an
+amortization bottleneck only if it recovers at least 70% of BP's depth gain, has at least 10/15
+positive paired gains, beats context-SDIL d4 by at least 2 points, has a mean lesion drop of at
+least 2 points with at least 10/15 positive lesions, and has no nonfinite final loss.
+
+**Direct causal diagnosis status: passed on 2026-07-22.** Direct NP recovered `106.6%` of BP's
+depth gain (`+30.447` versus `+28.553` points), reached `96.150 ± 1.719%` at d4, improved in 15/15
+depth pairs, and had positive lesions in 14/15 pairs. It beat context-SDIL d4 by `17.030` points;
+all losses were finite. The result rules out the local eligibility rule and causal direction as
+the primary C2 failure, but costs `68.4x` ordinary forward-equivalent work and is not a scalable
+solution.
+
+One calibration-quality recovery is now allowed on development task seed 0 only. It keeps the
+bounded context vectorizer, `eta=0.03`, `eta_A=0.01`, and every-four-step calibration fixed, and
+compares layerwise K4 against K16 at d1/d4 over model seeds 0--2. Select the higher mean d4
+validation accuracy, choosing K4 if it lies within one point of K16; any nonfinite candidate is
+ineligible. No result from task seeds 3--5 may enter this selection. A selected protocol must be
+frozen before a new independent panel on task seeds 6--8, and that panel must satisfy the original
+C2 gain/comparator/lesion conditions plus at least 10/15 positive depth gains and finite losses.
+
### C3. Causal calibration is genuinely amortized
**Status: passed on 2026-07-22.** The frozen five-seed confirmation retained 112.9% of the K16/e4