diff options
| author | Yuren Hao <yurenh2@illinois.edu> | 2026-07-29 20:51:05 -0500 |
|---|---|---|
| committer | Yuren Hao <yurenh2@illinois.edu> | 2026-07-29 20:51:05 -0500 |
| commit | 1bce876b60e529d4cbaf6fed40c5acc051ff43f2 (patch) | |
| tree | c1a483844c4fe0cf36351feb9872075766cdef12 /docs/campaign/CASCADE_ABLATION_PLAN.md | |
| parent | 68ba9c7e91a352c8d81b40f5e80067b52cce4dd6 (diff) | |
RESULT 74: Phase M发射计划(用户批准) — 2×减半阶梯(C128/C192/C320新点+现有两点=五点跨12×);量纲审计元规律(碎的全是有量纲常数,活的全是结构/协议);逐级盲外推协议(×128=必测预测题),交付物=外推地平线曲线
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'docs/campaign/CASCADE_ABLATION_PLAN.md')
| -rw-r--r-- | docs/campaign/CASCADE_ABLATION_PLAN.md | 21 |
1 files changed, 21 insertions, 0 deletions
diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md index c29d476..931bee7 100644 --- a/docs/campaign/CASCADE_ABLATION_PLAN.md +++ b/docs/campaign/CASCADE_ABLATION_PLAN.md @@ -578,6 +578,27 @@ power law (dose ~ width^k -> soft wall, budget k for 270M) vs width THRESHOLD ne 0.076 gap hides a small closable leak (lk512 arms answer directly). Chained behind fw135m_dg128 on all three GPUs; ~12h of ladder after the validation completes. +### RESULT 74 (2026-07-29): PHASE M LAUNCH PLAN (user-approved) — the 2x-halving ladder + +successive-blind-extrapolation protocol; the deliverable is the EXTRAPOLATION-HORIZON CURVE. +Criterion (user): everything serves transfer to 1B & 8B; experience that cannot survive scale +jumps has zero inductive value. Meta-diagnosis from the wreckage: every broken constant was +DIMENSIONAL (beta, res-gate, amp certificate, dgain=128); everything that transferred was +STRUCTURAL (K-saturation, bsign stability, free-phase=forward) or a MEASUREMENT PROTOCOL +(rho probe, leak instrument). Transferable assets can only take three forms: dimensionless +laws, structural invariants, measurement protocols. A standing DIMENSIONAL AUDIT table will +classify every recipe element. +LADDER (frozen 72M recipe, no per-size tuning, class-1 data): C128/11M, C192/18M, C320/36M +(new, EP+BP twins, n=2 each, Chinchilla 20 tok/param) + existing C512/72M, C768/135M = five +points spanning 12x params. Queued behind dg128 on all 3 GPUs (~9h). +PROTOCOL (strengthened): fit any law on the SMALLEST points only; blind-predict upward rung +by rung (C320 -> C512 -> C768 -> C1152); the x128 dose at C768 is a mandatory PREDICTION +target. Log prediction error vs extrapolation factor = the horizon curve. Horizon >= 3x -> +1B (1.8x beyond C1152) is within demonstrated range; horizon < 1.5x -> the honest verdict is +"EP-transformer experience does not compress into transferable laws", which is decisive for +the hardware thesis too (a chip is a frozen recipe). +After trainings: M1 displacement spectroscopy + M2 per-nonlinearity linearization battery + +M3 optimizer-step differentials at every width; PREREG freeze before any validation run. + ### RESULT 73 (2026-07-29): GOVERNING DOCTRINE (user ruling) — NO TRANSFERABLE SCALING KNOWLEDGE EXISTS YET; positive scaling claims SUSPENDED; results reclassified into three strict classes; next phase = mechanism identification with a pre-registered transfer law and |