diff options
Diffstat (limited to 'docs/campaign/CASCADE_ABLATION_PLAN.md')
| -rw-r--r-- | docs/campaign/CASCADE_ABLATION_PLAN.md | 21 |
1 files changed, 21 insertions, 0 deletions
diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md index 76cf71d..ede9c39 100644 --- a/docs/campaign/CASCADE_ABLATION_PLAN.md +++ b/docs/campaign/CASCADE_ABLATION_PLAN.md @@ -76,6 +76,27 @@ flag) and/or lambda_l per-layer energy weighting (B4). Follow-on (not yet launch the higher floor (larger nudge). If floors DON'T help -> escalate to double-sided estimator (cancels O(beta) Taylor bias, allows large beta, 2x cost) or lambda_l energy weighting. +### RESULT 2 (2026-07-10 01:26): beta-floor CONFIRMED as the depth fix. +Paired seed-1 sweep, cos in the erosion zone (where control collapses): +| arm | cos @2000..4000 | best CE | skips | +|---|---|---|---| +| K3 control (floor 0) | 0.977 -> 0.944 -> **0.896@4000** | 2.0009 | **17** | +| bf1e4 (floor 1e-4) | 0.9996 (nearly flat) | 2.174@2000 (desc) | 0 | +| bf3e4 (floor 3e-4) | **1.0000 flat** | 2.161@2000 (desc) | 0 | +- Flooring beta_t ELIMINATES the erosion: bf3e4 holds cos=1.0000 exactly where the un-floored control + collapses to 0.896 w/ 17 skips. Higher floor monotonically better CE at matched steps (3e-4 < 1e-4 < + control). 3e-4 already achieves perfect cos + zero drift/skips -> the operating point (higher can only + add Taylor bias). The un-floored control still banked best 2.0009 (from ~step 3200 before the late + collapse), so beta-floor's CE win over 2.0009 is the depth-tax recovery. +- **K4 verdict LAUNCHED:** d1b_ep_bf3e4_s1/s2/s3 (floor 3e-4) 4000 steps vs BP 1.9169/1.9194/1.9214 + (1.9192). If EP 3-seed ~ 1.919 -> **K4 depth-parity SEALED at L12xC512 (real GPT-small shape)** -> + green-light D1b long-run demo (the "neng kan" gate) + hardware outreach. Poller baqcm84j4 armed. +- FIX SHIPPED to trainer: `--beta_floor` is the depth knob. Recommend it becomes default-on (e.g. 3e-4) + for L>=12; harmless at L6 (schedule never drops that low there). NOTE for the paper: this is a clean + "EP as configuration microscope" second instance -- depth exposes a finite-beta SNR floor that BP + (exact grad, scale-robust) never sees; the floor is the physical-relaxation analog of gradient + precision. Muon-on-EP arm still pending after the verdict. + ## STATUS 2026-07-09 (same day): Tier 0 CLOSED GREEN via the zil scheme; C1 running - **Naive relaxation FAILS at depth** (the B1-lite sweep): jacobi K=40·L → cos 0.82 (L6) / 0.67 (L12) |