summaryrefslogtreecommitdiff
path: root/ep_run
AgeCommit message (Expand)Author
2026-07-17ride-v2: (a) floor-jump cap continuity (the 0.09 bug), (b) rho-EMA decisions,...Yuren Hao
2026-07-17save final ckpt at last step (fixed-eval protocol); fw72m_ride crown-3 launch...Yuren Hao
2026-07-16Deck finalized: both verdicts sealed (C512 zero-gap, 72M gap 0.043), decoupli...Yuren Hao
2026-07-16--beta_ride ceiling-riding governor (two-sided bcap: climb in calm, attack ne...Yuren Hao
2026-07-16RESULT 29: qcomp8 tax-free (+0.0018) = T64 8-bit compute green light; --centm...Yuren Hao
2026-07-16Stage-0 BP mirror arms: qup/qcomp flags in casc_bp_train; bp_qctl + 6 quant a...Yuren Hao
2026-07-16Stage-0 gate #1b: --qcomp_bits (compute on DAC-grid weights, fp32 master = T6...Yuren Hao
2026-07-15Stage-0 gate #1: --qup_bits (absolute-grid stochastic-rounding weight quantiz...Yuren Hao
2026-07-15ERRATUM RESULT 21: original best 3.7117 was @104.8k not @185k — 90k-step wa...Yuren Hao
2026-07-15assets/: organize into decks|figs|hw|refs|misc; scripts + gitignore repointedYuren Hao
2026-07-15Alexi primer deck: 10 slides (arch op-by-op, EP phases, schedule/parallelism,...Yuren Hao
2026-07-15centfast (doubled-batch +/-beta centered, cos 1.000000000 vs sequential, DDP-...Yuren Hao
2026-07-15RESULT 25: bias decomposition probe — 100% between-block transmission (TRAN...Yuren Hao
2026-07-14sync: add stage1b_bp_muon (42M BP twin) to TS project + report runsetYuren Hao
2026-07-14sync: negative-cos regex fix, f3e3cont log mapping, SYNC_ID_SUFFIX; full inve...Yuren Hao
2026-07-14RESULT 21: crown sealed — 72.11M x 1.44B tokens fully BP-free (largest to d...Yuren Hao
2026-07-14wandb reorganized: per-regime team projects (ept-tinystories-42m / ept-finewe...Yuren Hao
2026-07-14wandb -> team entity eqprop-llm-training (trainers + full-history replay script)Yuren Hao
2026-07-14bcap v2: absolute-scale gate on rho meter (fixes v1 noise-floor starvation), ...Yuren Hao
2026-07-14beta-cap-by-loop-gain controller (--beta_cap_rho): rho^ meter from sweep resi...Yuren Hao
2026-07-14Adaptive relax (--relax_tol): sweep-to-tolerance + rho-triggered geta backtra...Yuren Hao
2026-07-13Estimator arms machinery: --est centered/richardson (two-pass, O(b^2) bias), ...Yuren Hao
2026-07-13Fix swallowed --wandb_run arg (replace-comment bug); wandb default-on intactYuren Hao
2026-07-13wandb ON by default in both trainers (project ept-cascade); BP twin gains --a...Yuren Hao
2026-07-13fw72m crown run launched (NCCL DDP prod), exact resume (opt state), RESULT 17...Yuren Hao
2026-07-13Manual DDP for cascade-EP: guard-synced (drift/kretry via global max, gn on r...Yuren Hao
2026-07-13Stage-2 data pipeline: FineWeb-Edu sample-10BT -> 32k BPE -> bins; --data fla...Yuren Hao
2026-07-12bf16 mixed-precision (--amp): gate PASSED (cos 0.9682 vs fp32 0.9687), traine...Yuren Hao
2026-07-12E-tier wave-1 ledger (RESULT 14 + HW map rows) + cost model v2 recalibrated o...Yuren Hao
2026-07-12RESULT 13: bsign neutral at 4k (1.7382 vs 1.7314); 42M gap-chasing closed at ...Yuren Hao
2026-07-11RESULT 11: stage1b sealed (gap 0.050); beta ceiling unfound (3e-3 -> cos 0.99...Yuren Hao
2026-07-10RESULT 10: epoch endpoints (BP 1.2509/1.2750 vs EP 1.4802, +0.22 erosion cost...Yuren Hao
2026-07-10Sustained dose-response sealed (3e-4/5e-4/1e-3 -> 0.975/0.983/0.990); ship --...Yuren Hao
2026-07-10RESULT 6: wall-2 = EP-specific marginal under-convergence at the contractivit...Yuren Hao
2026-07-10OLMo2-standard architecture (user directive): norm-after-sublayer RMSNorm blo...Yuren Hao
2026-07-10AUDIT: retract confounded Muon verdict; tone down parity claims (n=3, best-of...Yuren Hao
2026-07-10Stage-1 epoch blowup @12100: sig story REFUTED (only +8%, cos fine till after...Yuren Hao
2026-07-10QK-norm: replace nn.MHA with explicit SDPA attn + --qk_norm (OLMo2-style, ana...Yuren Hao
2026-07-10Add --cosine (warmup->cosine decay to 0.1x lr) to both cascade trainers for f...Yuren Hao
2026-07-10K refuted as L12 lever (cos K-invariant K3==K8); BP 3-seed sealed 1.919; mech...Yuren Hao
2026-07-09BP-free formal audit (5.6-sol): EP update verified local (108 bitwise zero-in...Yuren Hao
2026-07-09A0.4 precision gate (TF32 harmless cos 0.9946==fp32; pure-bf16 cos 0.9427) + ...Yuren Hao
2026-07-09casc_eq_train: exact mode (dtop_every=1) now DEFAULT — bisection showed the...Yuren Hao
2026-07-09casc_eq_train v7: two algorithmic dedups — d_top refreshed every other roun...Yuren Hao
2026-07-09casc_eq_train v6: graph-reuse fb (rebuild graphs feed next round's vjps), --c...Yuren Hao
2026-07-09cascade root cause found: tied readout + default N(0,1) embedding init = path...Yuren Hao
2026-07-09casc_eq_train v4: quality-governed estimator — periodic measured cos(EP,BP)...Yuren Hao
2026-07-09casc_eq_train v3: adaptive beta (tok-sigma stiffness compensation), adaptive-...Yuren Hao
2026-07-09cascade equilibrium solver solved: fb (forward-backward message passing) K=3 ...Yuren Hao
2026-07-09casc_eq_train: equilibrium-mode cascade-EP trainer (GS-reverse solver K sweep...Yuren Hao