summaryrefslogtreecommitdiff
path: root/ep_run/casc_eq_train.py
AgeCommit message (Expand)Author
2026-07-13Stage-2 data pipeline: FineWeb-Edu sample-10BT -> 32k BPE -> bins; --data fla...Yuren Hao
2026-07-12bf16 mixed-precision (--amp): gate PASSED (cos 0.9682 vs fp32 0.9687), traine...Yuren Hao
2026-07-12RESULT 13: bsign neutral at 4k (1.7382 vs 1.7314); 42M gap-chasing closed at ...Yuren Hao
2026-07-11RESULT 11: stage1b sealed (gap 0.050); beta ceiling unfound (3e-3 -> cos 0.99...Yuren Hao
2026-07-10RESULT 10: epoch endpoints (BP 1.2509/1.2750 vs EP 1.4802, +0.22 erosion cost...Yuren Hao
2026-07-10Sustained dose-response sealed (3e-4/5e-4/1e-3 -> 0.975/0.983/0.990); ship --...Yuren Hao
2026-07-10RESULT 6: wall-2 = EP-specific marginal under-convergence at the contractivit...Yuren Hao
2026-07-10OLMo2-standard architecture (user directive): norm-after-sublayer RMSNorm blo...Yuren Hao
2026-07-10AUDIT: retract confounded Muon verdict; tone down parity claims (n=3, best-of...Yuren Hao
2026-07-10Stage-1 epoch blowup @12100: sig story REFUTED (only +8%, cos fine till after...Yuren Hao
2026-07-10QK-norm: replace nn.MHA with explicit SDPA attn + --qk_norm (OLMo2-style, ana...Yuren Hao
2026-07-10Add --cosine (warmup->cosine decay to 0.1x lr) to both cascade trainers for f...Yuren Hao
2026-07-10K refuted as L12 lever (cos K-invariant K3==K8); BP 3-seed sealed 1.919; mech...Yuren Hao
2026-07-09BP-free formal audit (5.6-sol): EP update verified local (108 bitwise zero-in...Yuren Hao
2026-07-09A0.4 precision gate (TF32 harmless cos 0.9946==fp32; pure-bf16 cos 0.9427) + ...Yuren Hao
2026-07-09casc_eq_train: exact mode (dtop_every=1) now DEFAULT — bisection showed the...Yuren Hao
2026-07-09casc_eq_train v7: two algorithmic dedups — d_top refreshed every other roun...Yuren Hao
2026-07-09casc_eq_train v6: graph-reuse fb (rebuild graphs feed next round's vjps), --c...Yuren Hao
2026-07-09cascade root cause found: tied readout + default N(0,1) embedding init = path...Yuren Hao
2026-07-09casc_eq_train v4: quality-governed estimator — periodic measured cos(EP,BP)...Yuren Hao
2026-07-09casc_eq_train v3: adaptive beta (tok-sigma stiffness compensation), adaptive-...Yuren Hao
2026-07-09cascade equilibrium solver solved: fb (forward-backward message passing) K=3 ...Yuren Hao
2026-07-09casc_eq_train: equilibrium-mode cascade-EP trainer (GS-reverse solver K sweep...Yuren Hao
generated by cgit v1.2.3 (git 2.25.1) at 2026-08-18 13:39:04 +0000