From db09d8f0ca4367b424f8714ce02c85391f71d0cf Mon Sep 17 00:00:00 2001 From: Yuren Hao Date: Fri, 17 Jul 2026 10:56:23 -0500 Subject: =?UTF-8?q?RESULT=2038:=202D=20update-field=20analysis=20=E2=80=94?= =?UTF-8?q?=20localized=20curl=20blob=20at=20beta=3D1e-2=20(conservative?= =?UTF-8?q?=20near=20basins),=20EP/BP=20different-basin=20equal-depth=20(b?= =?UTF-8?q?arrier=208.25);=20fieldviz.py?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Co-Authored-By: Claude Fable 5 Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn --- docs/campaign/CASCADE_ABLATION_PLAN.md | 30 ++++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) (limited to 'docs') diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md index 97940d8..e7146c0 100644 --- a/docs/campaign/CASCADE_ABLATION_PLAN.md +++ b/docs/campaign/CASCADE_ABLATION_PLAN.md @@ -568,6 +568,36 @@ direction), not training-under-fault; wave-2 = co-training with faults injected +### RESULT 38 (2026-07-17): 2D UPDATE-FIELD ANALYSIS (professor's suggestion) — the finite-beta field IS non-conservative, but only where training doesn't live; EP and BP reach DIFFERENT, equally deep basins. +Method: fieldviz.py — full-model PCA plane over 27 snapshots of 5 runs (49% trajectory variance); +13x13 grid; loss contours + three update fields (BP, EP@3e-4, EP@1e-2; 2-batch averaged; +block-subspace projection); finite-difference curl; ride<->BP linear interpolation. +| field | curl RMS | +|---|---| +| BP (conservative reference / noise floor) | 4.38e-6 | +| EP @ 3e-4 (operating beta) | 4.41e-6 (= floor) | +| EP @ 1e-2 | 1.37e-5 (3.1x floor) | +Findings: +1. NON-CONSERVATIVITY IS REAL AND LOCALIZED: at beta=1e-2 a coherent positive-curl blob appears + in the steep high-loss region (large states/gradients -> large bias field c(theta)); BP and + EP@3e-4 show pure noise. NEAR THE BASINS — where training actually operates — the EP field + stays conservative-within-noise even at 10x operating beta. Same-batch BP control shows no + blob => EP-specific, not data noise. +2. Two-level echo for the dynamics paper: parameter-space curl concentrates exactly where the + loop-gain hazard lives (big sigma*||J||) — the state-space non-conservativity story reappears + one level up, scaled by beta. Training under finite-beta EP = a mildly non-gradient flow that + is gradient-like precisely in the region the governor keeps it in. +3. DIFFERENT BASINS, EQUAL DEPTH: ride(s50k) 1.4325 vs BP(s55k) 1.4156 with an 8.25 barrier + (~random-level) between them — same seed/init, methods branch at step 0 and land in linearly + disconnected but equally good minima. The EP family (plain/ride/cent) clusters in one plane + region, BP in another. + CONTROL PENDING: BP-s1 <-> BP-s2 interpolation (does BP-vs-BP also barrier? decides whether + different-basin is EP-specific or generic) — runs when the seed chain delivers bp_s2. + Cheap follow-ups queued: EP<->EP interp (expected flat); curl-vs-beta scaling curve at a + near-basin point and a steep point (the quantitative bridge figure for aep-dynamics). +Caveats: 2D slice (49% variance); curl from 2-batch-averaged fields on a 13x13 grid; barrier +statement is linear-path only (no permutation alignment attempted). + ### RESULT 37 (2026-07-17): RIDE FAILS AT 72M — weight poisoning via permissive guards during beta surfing; crown-3 relaunched as PLAIN from the clean ckpt. Timeline (fw72m_ride): healthy surf to ~48k; at 72M the governor never found the 42M-style smooth hover — beta banged between 1.5e-4 and 1.85e-2 (rho-hat is noisy/laggy at this scale). ~54k: -- cgit v1.2.3