summaryrefslogtreecommitdiff
path: root/docs/campaign
AgeCommit message (Collapse)Author
2026-07-12RESULT 15 (amp lossless 1.56x) + COST_MODEL v2.1 (sourced July-2026 prices, ↵Yuren Hao
EF unit fix) + Draft 6 cost/scale rewrite Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12E-tier wave-1 ledger (RESULT 14 + HW map rows) + cost model v2 recalibrated ↵Yuren Hao
on measured H200 datapoint Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12RESULT 13: bsign neutral at 4k (1.7382 vs 1.7314); 42M gap-chasing closed at ↵Yuren Hao
noise floor; pivot to Stage-2 pipeline + E-tier
2026-07-11RESULT 12: f3e3cont negative (1.2883 vs 1.2808) — residual gap not ↵Yuren Hao
beta-liftable; next lever = random-sign beta (single-phase, KHS-validated), then centered
2026-07-11STANDING: looped line abandoned (user directive) — cascade-only default; ↵Yuren Hao
looped = historical data for dynamics paper
2026-07-11RESULT 11: stage1b sealed (gap 0.050); beta ceiling unfound (3e-3 -> cos ↵Yuren Hao
0.9974); K exonerated on OLMo2; bf16 naive-cast dead at any beta (TF32 stays cost baseline); f3e3 CE-endpoint cont launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10Queue: double-sided nudge after stage1b (0.22 = differential-measurement SNR ↵Yuren Hao
tax, escalation ladder recorded)
2026-07-10RESULT 10: epoch endpoints (BP 1.2509/1.2750 vs EP 1.4802, +0.22 erosion ↵Yuren Hao
cost); GENERATION GATE PASSED (casc_gen.py, coherent stories, no-backprop 42.75M); stage1b improved-recipe pair launched (Muon cosine via build_hybrid) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10cos<0.96: flagship stays as control; bf1e3 continuation from s40000 queued ↵Yuren Hao
on farm -> endpoint quad EP-ctl/EP-lift/BPx2
2026-07-10Sustained dose-response sealed (3e-4/5e-4/1e-3 -> 0.975/0.983/0.990); ship ↵Yuren Hao
--bf_late floor ramp; next-run recipe locked (OLMo2+Muon+late-ramp)
2026-07-10RESULT 8 sealed (Muon 3v3: BP 1.7098 / EP 1.7314); beta-floor dose-response ↵Yuren Hao
@25k: 3e-4/5e-4/1e-3 -> cos 0.984/0.989/0.994, stable at 1e-3; Stage-2 recipe = late floor ramp
2026-07-10Watch: late-epoch cos erosion = intrinsic late-training SNR decline; let it ↵Yuren Hao
run, BP twins are the measurement; floor-probe queued
2026-07-10RESULT 8 final: Muon generic (+0.13 both columns; BP+Muon 1.7020 vs EP+Muon ↵Yuren Hao
1.7254); Muon default from Stage-2; 3v3 fill launched
2026-07-10RESULT 9: wall-2 ELIMINATED by OLMo2 arch — epoch cleared 10-14k with zero ↵Yuren Hao
guard events (old arch: blowup@12100); cos-erosion watch armed
2026-07-10RESULT 8 prelim: Muon+beta_floor on EP = 1.7316 (-0.098 vs AdamW, n=1, zero ↵Yuren Hao
skips); retraction closed; BP+Muon control + s2 launched
2026-07-10RESULT 7: OLMo2 parity PASS (BP 1.8335 vs EP 1.8643, gap +0.031 within ↵Yuren Hao
metric noise); arch worth ~0.08 CE both columns; epoch auto-launched; Pascal unbanned (canaries green), farm running 2xBP epochs + Muon retest
2026-07-10RESULT 6 addendum: K8 also blew at 12600 -> wall-2 is true contractivity ↵Yuren Hao
crossing (K delays only); kretry demoted to mitigation; defense = OLMo2 arch > lr channel > damped-fb/jacreg
2026-07-10RESULT 6: wall-2 = EP-specific marginal under-convergence at the ↵Yuren Hao
contractivity edge (A skips16/B skips2/C skips1/D-BP clean); ship --kretry (retry marginal batches at K=kmax); launch OLMo2 parity matrix with parity-gated epoch autolaunch Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10AUDIT: retract confounded Muon verdict; tone down parity claims (n=3, ↵Yuren Hao
best-of-noisy-val); scope depth-tax claim to 4k horizon; guard-split skip telemetry (skd/skg); add BP control arm diag_D_bp (+--resume in BP trainer); record resume confounds Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10Stage-1 epoch blowup @12100: sig story REFUTED (only +8%, cos fine till ↵Yuren Hao
after); leading indicator=drift-guard skips -> contractivity bifurcation in nudged relaxation (cascade Hopf wall); add resume/sig0/final_ln; A/B/C diagnostic launched
2026-07-10RESULT 4: QK-norm validated parity-preserving (EP 1.8868 <= BP 1.9066); ↵Yuren Hao
qk_norm complements but does NOT replace beta-floor (sig_tok still grows); Stage 1 TinyStories epoch launched
2026-07-10QK-norm: replace nn.MHA with explicit SDPA attn + --qk_norm (OLMo2-style, ↵Yuren Hao
analog-friendly); cancel epoch, insert 8-run qk validation, stage roadmap TinyStories-epoch->FineWeb-Edu->OLMo2
2026-07-10RESULT 3: K4 depth-parity SEALED EP-favorable (EP 1.8907 <= BP 1.9192 @ ↵Yuren Hao
L12xC512); full-epoch generation run auto-launched (6.9h)
2026-07-10CORRECTION: D1a did not die (misread mangled proc scan); originals completed ↵Yuren Hao
s1 1.9745/s2 2.0013/s3 2.1188 + muon 2.7515; beta-floor fix independently found on free GPU1 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10RESULT 2: beta-floor confirmed as L12 depth fix (3e-4 holds cos=1.0 vs ↵Yuren Hao
control collapse 0.896); K4 3-seed verdict launched vs BP 1.9192 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10K refuted as L12 lever (cos K-invariant K3==K8); BP 3-seed sealed 1.919; ↵Yuren Hao
mechanism = finite-beta SNR collapse; add --beta_floor/--beta_fixed + launch floor sweep Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09D1a autopsy + K-ladder diagnostic: parent-death (not nohup'd) killed 4 arms; ↵Yuren Hao
L12 cos-erosion signal; relaunched K3/K8/BPs3 nohup Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09notes refresh: plan status stamp (K1-K3 sealed, D-tier in flight), ↵Yuren Hao
ONBOARDING cascade-pivot section Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09FINDINGS: 2026-07-11 consolidated hardening entryYuren Hao
2026-07-09FINDINGS: K3 sealed — matched-tuning parity n=3 (EP 2.0500+-0.015 vs BP ↵Yuren Hao
2.0530+-0.004), the three-act retraction arc documented Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09FINDINGS: final C1 verdict — equilibrium fb-EP 2.2949 beats BP 2.3694 ↵Yuren Hao
(same init/seed/steps), cos 1.0000 throughout, 3.9x BP cost Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09FINDINGS: cascade pivot one-day arc — bridge, solver saga, fb ↵Yuren Hao
message-passing, init root cause, diagC 2.9021 result Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09cascade: retire zil per user directive (EP route = equilibrium two-phase); ↵Yuren Hao
probe gains --init_sweep (state warm-start, EP-clean readout) and --sopt adam; B2 solver sweep Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09cascade: zil interleaved scheme = exact gradients at all depths (cos 1.0000 ↵Yuren Hao
L6-24, trajectory 0.9998+); casc_ep_train zil trainer; naive-relaxation depth failure documented Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09cascade ablation program: plan doc (5 claims, tiers 0-4), probe v2 ↵Yuren Hao
(jacobi/gsf/gsr schemes, full-theta gate, multi-batch), casc_bp_train ckpt producer Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-07FLAGSHIP: warm_fast 1.7065 final — beats tuned BP anchor by 0.086, ↵Yuren Hao
param-matched twin by 0.257 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-04FINDINGS: magic-s2000 mechanism entry (stability-dip audit)Yuren Hao
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-03omega/norm-family refuted as stability signal; fingerprint story retracted; ↵Yuren Hao
eigreg v2 = true map-eigenvalue (spec_penalty) - eig_control: fix plain-PI bug (shifted PI for lambda_max of indefinite Sym); add lead_rho + spec_penalty (soft one-sided cap on |lam|(I+eps*J_F), 2-D Rayleigh-Ritz, matvec-only) — aep 'spectral' ported. eig_penalty demoted to diagnostic. - eig_recheck.py (Lanczos audit): omega=+5..+13 on ALL operators incl the stablest (s2000 +12.8 while true alpha=-0.02); gap omega-alpha~10; old 'warm -10.14 vs scratch +1.11' numbers were PI-mixture artifacts. RETRACTED. - eig_v2_smoke/depth: v2 mechanics validated vs ARPACK; z_T1 readings >1 are unconverged-state contamination (150: 1.009 -> 400/800: 0.997-0.999, mu=-0.02..-0.006 matching eig_probe); fixed-point top = BAND of slow modes. - lt_ep_train: --eigreg now spec_penalty (--eig_margin 0.995 = rho target); --fingerprint reports rho/Re_mu instead of num_abscissa. - ONBOARDING §4-7 + FINDINGS 2026-07-03: retraction + verdict (fundamental quantity = finite-horizon path LE / resreg axis; de-cliff via floss-ept; spec_penalty = measure-mode scalpel for a detaching Hopf pair). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-03Initial commit: ept — backprop-free equilibrium transformer (EP)Yuren Hao
Code (ep_run/), organized docs (docs/{method,campaign,hardware,outreach,paper}), analysis scripts (scripts/), ONBOARDING.md entry point. Large data/checkpoints git-ignored (share separately). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
generated by cgit v1.2.3 (git 2.25.1) at 2026-08-18 18:35:57 +0000