diff options
Diffstat (limited to 'docs/campaign')
| -rw-r--r-- | docs/campaign/CASCADE_ABLATION_PLAN.md | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md index 82e214d..a182507 100644 --- a/docs/campaign/CASCADE_ABLATION_PLAN.md +++ b/docs/campaign/CASCADE_ABLATION_PLAN.md @@ -408,3 +408,15 @@ If BP+Muon lands ~1.73 too -> Muon helps both equally (parity preserved, recipe columns). If BP+Muon ~1.83 -> EP-specific synergy (bigger story, needs replication before claiming). Interim: BP-twin epochs healthy at ~13.7k (best ~1.60 — already past the old-arch EP wall step); local EP epoch at 4.8k, best 1.8148, zero skips, 1.97 it/s. + +### RESULT 9 (2026-07-10 13:1x): WALL-2 ELIMINATED BY ARCHITECTURE — epoch cleared 10-14k with ZERO guard events. +stage1_ol_ep cleared the wall window (through step 14300): **skips=0 (d0/g0/r0) THE ENTIRE RUN** — not +one drift rejection, not one gn rejection, kretry never fired. (Old arch: 32 skips by 13000, blowup at +12100; K8 variant blew by 12600.) gn calm (~0.5), best val 1.6702 and descending at 1.97 it/s. +**OLMo2's bounded operator (norm-after-sublayer + QK-norm) stays contractive where the old block went +divergent — defense #1 closed the case; mitigations (kretry) unused.** The architecture change, made +for digital-standardness, is also the EP stability fix — "EP as configuration microscope" ends as +"modern standard config is EP-compatible out of the box." +WATCH ITEM: cos drifting slowly (0.9947@6k -> 0.9892@14k), beta already at floor. Watcher re-armed +with cos<0.985 trigger; if it keeps sliding by ~30k, try beta_floor 5e-4 or accept (grad quality still +fine at 0.989). Remaining epoch ETA ~6h. |