From 5ad46a697bbc2fa23ef2f202b3898edac7ac9d1b Mon Sep 17 00:00:00 2001 From: Yuren Hao Date: Fri, 10 Jul 2026 14:32:46 -0500 Subject: =?UTF-8?q?RESULT=209:=20wall-2=20ELIMINATED=20by=20OLMo2=20arch?= =?UTF-8?q?=20=E2=80=94=20epoch=20cleared=2010-14k=20with=20zero=20guard?= =?UTF-8?q?=20events=20(old=20arch:=20blowup@12100);=20cos-erosion=20watch?= =?UTF-8?q?=20armed?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- docs/campaign/CASCADE_ABLATION_PLAN.md | 12 ++++++++++++ 1 file changed, 12 insertions(+) (limited to 'docs/campaign') diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md index 82e214d..a182507 100644 --- a/docs/campaign/CASCADE_ABLATION_PLAN.md +++ b/docs/campaign/CASCADE_ABLATION_PLAN.md @@ -408,3 +408,15 @@ If BP+Muon lands ~1.73 too -> Muon helps both equally (parity preserved, recipe columns). If BP+Muon ~1.83 -> EP-specific synergy (bigger story, needs replication before claiming). Interim: BP-twin epochs healthy at ~13.7k (best ~1.60 — already past the old-arch EP wall step); local EP epoch at 4.8k, best 1.8148, zero skips, 1.97 it/s. + +### RESULT 9 (2026-07-10 13:1x): WALL-2 ELIMINATED BY ARCHITECTURE — epoch cleared 10-14k with ZERO guard events. +stage1_ol_ep cleared the wall window (through step 14300): **skips=0 (d0/g0/r0) THE ENTIRE RUN** — not +one drift rejection, not one gn rejection, kretry never fired. (Old arch: 32 skips by 13000, blowup at +12100; K8 variant blew by 12600.) gn calm (~0.5), best val 1.6702 and descending at 1.97 it/s. +**OLMo2's bounded operator (norm-after-sublayer + QK-norm) stays contractive where the old block went +divergent — defense #1 closed the case; mitigations (kretry) unused.** The architecture change, made +for digital-standardness, is also the EP stability fix — "EP as configuration microscope" ends as +"modern standard config is EP-compatible out of the box." +WATCH ITEM: cos drifting slowly (0.9947@6k -> 0.9892@14k), beta already at floor. Watcher re-armed +with cos<0.985 trigger; if it keeps sliding by ~30k, try beta_floor 5e-4 or accept (grad quality still +fine at 0.989). Remaining epoch ETA ~6h. -- cgit v1.2.3