summaryrefslogtreecommitdiff
path: root/ep_run/casc_eq_train.py
AgeCommit message (Expand)Author
2026-07-18RESULT 43+44: crown-3 死因=cap硬底钉在塌落天花板之上(变相wall-...Yuren Hao
2026-07-18--bpmix: gap-source ablation (overwrite EP grads with true BP grads per modul...Yuren Hao
2026-07-17--beta_sync: synchronous acceptance (this-step relax telemetry gates the comm...Yuren Hao
2026-07-17ride-v2 (b)/(c) flag-gated (--ride_ema/--ride_cool, default off); isolation p...Yuren Hao
2026-07-17ride-v2: (a) floor-jump cap continuity (the 0.09 bug), (b) rho-EMA decisions,...Yuren Hao
2026-07-17save final ckpt at last step (fixed-eval protocol); fw72m_ride crown-3 launch...Yuren Hao
2026-07-16--beta_ride ceiling-riding governor (two-sided bcap: climb in calm, attack ne...Yuren Hao
2026-07-16RESULT 29: qcomp8 tax-free (+0.0018) = T64 8-bit compute green light; --centm...Yuren Hao
2026-07-16Stage-0 gate #1b: --qcomp_bits (compute on DAC-grid weights, fp32 master = T6...Yuren Hao
2026-07-15Stage-0 gate #1: --qup_bits (absolute-grid stochastic-rounding weight quantiz...Yuren Hao
2026-07-15centfast (doubled-batch +/-beta centered, cos 1.000000000 vs sequential, DDP-...Yuren Hao
2026-07-14wandb reorganized: per-regime team projects (ept-tinystories-42m / ept-finewe...Yuren Hao
2026-07-14wandb -> team entity eqprop-llm-training (trainers + full-history replay script)Yuren Hao
2026-07-14bcap v2: absolute-scale gate on rho meter (fixes v1 noise-floor starvation), ...Yuren Hao
2026-07-14beta-cap-by-loop-gain controller (--beta_cap_rho): rho^ meter from sweep resi...Yuren Hao
2026-07-14Adaptive relax (--relax_tol): sweep-to-tolerance + rho-triggered geta backtra...Yuren Hao
2026-07-13Estimator arms machinery: --est centered/richardson (two-pass, O(b^2) bias), ...Yuren Hao
2026-07-13Fix swallowed --wandb_run arg (replace-comment bug); wandb default-on intactYuren Hao
2026-07-13wandb ON by default in both trainers (project ept-cascade); BP twin gains --a...Yuren Hao
2026-07-13fw72m crown run launched (NCCL DDP prod), exact resume (opt state), RESULT 17...Yuren Hao
2026-07-13Manual DDP for cascade-EP: guard-synced (drift/kretry via global max, gn on r...Yuren Hao
2026-07-13Stage-2 data pipeline: FineWeb-Edu sample-10BT -> 32k BPE -> bins; --data fla...Yuren Hao
2026-07-12bf16 mixed-precision (--amp): gate PASSED (cos 0.9682 vs fp32 0.9687), traine...Yuren Hao
2026-07-12RESULT 13: bsign neutral at 4k (1.7382 vs 1.7314); 42M gap-chasing closed at ...Yuren Hao
2026-07-11RESULT 11: stage1b sealed (gap 0.050); beta ceiling unfound (3e-3 -> cos 0.99...Yuren Hao
2026-07-10RESULT 10: epoch endpoints (BP 1.2509/1.2750 vs EP 1.4802, +0.22 erosion cost...Yuren Hao
2026-07-10Sustained dose-response sealed (3e-4/5e-4/1e-3 -> 0.975/0.983/0.990); ship --...Yuren Hao
2026-07-10RESULT 6: wall-2 = EP-specific marginal under-convergence at the contractivit...Yuren Hao
2026-07-10OLMo2-standard architecture (user directive): norm-after-sublayer RMSNorm blo...Yuren Hao
2026-07-10AUDIT: retract confounded Muon verdict; tone down parity claims (n=3, best-of...Yuren Hao
2026-07-10Stage-1 epoch blowup @12100: sig story REFUTED (only +8%, cos fine till after...Yuren Hao
2026-07-10QK-norm: replace nn.MHA with explicit SDPA attn + --qk_norm (OLMo2-style, ana...Yuren Hao
2026-07-10Add --cosine (warmup->cosine decay to 0.1x lr) to both cascade trainers for f...Yuren Hao
2026-07-10K refuted as L12 lever (cos K-invariant K3==K8); BP 3-seed sealed 1.919; mech...Yuren Hao
2026-07-09BP-free formal audit (5.6-sol): EP update verified local (108 bitwise zero-in...Yuren Hao
2026-07-09A0.4 precision gate (TF32 harmless cos 0.9946==fp32; pure-bf16 cos 0.9427) + ...Yuren Hao
2026-07-09casc_eq_train: exact mode (dtop_every=1) now DEFAULT — bisection showed the...Yuren Hao
2026-07-09casc_eq_train v7: two algorithmic dedups — d_top refreshed every other roun...Yuren Hao
2026-07-09casc_eq_train v6: graph-reuse fb (rebuild graphs feed next round's vjps), --c...Yuren Hao
2026-07-09cascade root cause found: tied readout + default N(0,1) embedding init = path...Yuren Hao
2026-07-09casc_eq_train v4: quality-governed estimator — periodic measured cos(EP,BP)...Yuren Hao
2026-07-09casc_eq_train v3: adaptive beta (tok-sigma stiffness compensation), adaptive-...Yuren Hao
2026-07-09cascade equilibrium solver solved: fb (forward-backward message passing) K=3 ...Yuren Hao
2026-07-09casc_eq_train: equilibrium-mode cascade-EP trainer (GS-reverse solver K sweep...Yuren Hao