diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 04:51:49 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 04:51:49 -0500 |
| commit | d344f7fa4b8a6b907d364d1900348ca8e4b709ce (patch) | |
| tree | 13fcf933e308c918c8047aa343787a662044e962 /ROADMAP.md | |
| parent | e8d698e9da1e2441d1d137eb8f8ab6cd46b4282c (diff) | |
results: confirm C2 feedback amortization bottleneck
Diffstat (limited to 'ROADMAP.md')
| -rw-r--r-- | ROADMAP.md | 24 |
1 files changed, 24 insertions, 0 deletions
@@ -148,6 +148,30 @@ secondary conditions passed at the boundary. Context conditioning improves subst linear SDIL's 21.0% recovery but does not make causal-feedback learning reliable enough. The predeclared mechanism-recovery branch is closed and no C2 test panel will run. +The follow-up causal diagnosis replaces the learned vectorizer with direct layerwise antithetic +node-perturbation targets on every update. Task seed 0 and model seeds 0--2 were development-only: +an estimator/LR screen selected `eta=0.03`, and a predeclared smaller-K-within-one-point rule chose +K16 over K4. The frozen diagnosis then used task seeds 3--5, model seeds 0--4, d1/d4, the same +training-only validation splits, and no intermediate held-out metrics. It diagnoses an +amortization bottleneck only if it recovers at least 70% of BP's depth gain, has at least 10/15 +positive paired gains, beats context-SDIL d4 by at least 2 points, has a mean lesion drop of at +least 2 points with at least 10/15 positive lesions, and has no nonfinite final loss. + +**Direct causal diagnosis status: passed on 2026-07-22.** Direct NP recovered `106.6%` of BP's +depth gain (`+30.447` versus `+28.553` points), reached `96.150 ± 1.719%` at d4, improved in 15/15 +depth pairs, and had positive lesions in 14/15 pairs. It beat context-SDIL d4 by `17.030` points; +all losses were finite. The result rules out the local eligibility rule and causal direction as +the primary C2 failure, but costs `68.4x` ordinary forward-equivalent work and is not a scalable +solution. + +One calibration-quality recovery is now allowed on development task seed 0 only. It keeps the +bounded context vectorizer, `eta=0.03`, `eta_A=0.01`, and every-four-step calibration fixed, and +compares layerwise K4 against K16 at d1/d4 over model seeds 0--2. Select the higher mean d4 +validation accuracy, choosing K4 if it lies within one point of K16; any nonfinite candidate is +ineligible. No result from task seeds 3--5 may enter this selection. A selected protocol must be +frozen before a new independent panel on task seeds 6--8, and that panel must satisfy the original +C2 gain/comparator/lesion conditions plus at least 10/15 positive depth gains and finite losses. + ### C3. Causal calibration is genuinely amortized **Status: passed on 2026-07-22.** The frozen five-seed confirmation retained 112.9% of the K16/e4 |
