summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2026-07-17hw_sim v1.1: ENOB-after-cal 8.51b (clears 7.0 bar; per-bit mismatch model) + ↵Yuren Hao
noise budget 138.7uV vs 100uV floor = MARGINAL -> hardware wall-1 quantified, wants big nudges Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17hw_sim: bus-settle fix menu parked as Dillavou session question (incl user's ↵Yuren Hao
precharge-rotation idea) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17hw_sim v1: datasheet-anchored column — C_bus=5.4nF kills naive design ↵Yuren Hao
(16.6us); best comp point 3.14us borderline vs 3us commit gate; offset rejection x3088; three design options logged Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17hw_sim: circuit-as-code workflow stood up (PySpice/ngspice/skidl); cell_v0 ↵Yuren Hao
— 64-branch settle 1.14us (<=3us gate PASS), two-phase offset rejection x376; sync_wandb follow mode Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17RESULT 38: 2D update-field analysis — localized curl blob at beta=1e-2 ↵Yuren Hao
(conservative near basins), EP/BP different-basin equal-depth (barrier 8.25); fieldviz.py Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17--beta_sync: synchronous acceptance (this-step relax telemetry gates the ↵Yuren Hao
commit; reject -> halve beta, retry same batch; failed trial doubles as ceiling measurement for the ride cap) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17ride-v2 (b)/(c) flag-gated (--ride_ema/--ride_cool, default off); isolation ↵Yuren Hao
probe design: control|a|a+b|a+c|a+d|full at 72M mid-stage Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17ride-v2: (a) floor-jump cap continuity (the 0.09 bug), (b) rho-EMA ↵Yuren Hao
decisions, (c) 200-step post-attack cooldown, (d) adaptive drift ceiling (--drift_adapt); smoke: continuous beta across floor jump Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17RESULT 37 addendum: first wound = cap x floor-jump = beta 0.09 at step 20000 ↵Yuren Hao
(controller design bug); s50000-clean retracted; crown-3 relaunched from scratch Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17RESULT 37: ride fails at 72M (beta-scaled damage through beta-independent ↵Yuren Hao
guards -> weight poisoning); crown-3 relaunched as fw72m_plain from s50000; ride-v2 design lessons Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17Fairness protocol at scale: published-recipe anchor + proxy sweeps + ↵Yuren Hao
sensitivity curves + symmetric zero-tuning at 1B+ (muP optional at 300M) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17RESULT 36 pre-reg: fw72m_ride crown-3 + ride/BP seed campaign + BP-fairness ↵Yuren Hao
rule (no EP>BP claims without BP sweep) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-17save final ckpt at last step (fixed-eval protocol); fw72m_ride crown-3 ↵Yuren Hao
launched (plain+ride governor); ride/BP seed campaign on GPU0 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 34+35: beta-buyback partial (+0.035->+0.022); full-epoch trio sealed ↵Yuren Hao
— plain 1.0x zero-gap-class confirmed, ride governor best on both metrics, dip-statistics honesty rule Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16est15 sealed 1.2374 (band edge); beta-buyback arm qb6_b1e2 launched (RESULT ↵Yuren Hao
30 mechanism test) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 33: triple verdict — A/B neutral at 72M, dose-response monotone ↵Yuren Hao
thru 1e-2, ride governor beats all static betas (1.2562); stage1b_ride launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16Deck finalized: both verdicts sealed (C512 zero-gap, 72M gap 0.043), ↵Yuren Hao
decoupling twist, K-saturation + quant-matrix rows; window fig cent line SEALED Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 32: crown resealed — fw72m_cent 3.3318 vs BP 3.2884 (gap 0.043, 10x ↵Yuren Hao
reduction), zero guards over 234k, predictions beaten 8x Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16--beta_ride ceiling-riding governor (two-sided bcap: climb in calm, attack ↵Yuren Hao
near threshold); smoke: 3e-3 -> 2.4e-2 hover at ride cap, rho calm at 42M tail Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 31: decoupling — tail win is 101% beta, centered CE-neutral at 42M ↵Yuren Hao
tail; plain-full-epoch + 72M A/B queued post-crown; beta ablation auto-triggered Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 30: quantization Delta-vs-Delta — zero-tax at 8-bit operating point ↵Yuren Hao
for BOTH; EP-specific tax (1.4-8x) below it; beta-buyback prediction designed Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 29: qcomp8 tax-free (+0.0018) = T64 8-bit compute green light; ↵Yuren Hao
--centmirror ships (cos 1.000000000, 1.72x -> 1.39x) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 28 caveat: fp32-EP control insufficient — BP mirror is the decision ↵Yuren Hao
metric (user correction) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16Stage-0 BP mirror arms: qup/qcomp flags in casc_bp_train; bp_qctl + 6 quant ↵Yuren Hao
arms chained after qcomp (decision metric = Delta_EP vs Delta_BP) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16RESULT 28: Stage-0 gate #1 verdict (naked resident cells need >=10-12b; T64 ↵Yuren Hao
word-streaming exempt; qcomp = the decisive arm) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-16Stage-0 gate #1b: --qcomp_bits (compute on DAC-grid weights, fp32 master = ↵Yuren Hao
T64 word-streaming / shadow accumulation); qcomp8/6/4 launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15T64 procurement sheet: Taobao AD7528JN @ ¥3/pc (user-verified) — MDAC ↵Yuren Hao
line $11.4k -> ~$1.4k incl 50% screening overage; 3-phase screen protocol tied to Stage-0/Stage-1 gates Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15Stage-0 gate #1: --qup_bits (absolute-grid stochastic-rounding weight ↵Yuren Hao
quantization = finite analog cell levels); qup8/qup6/qup10 arms launched on GPU0 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15RESULT 27: K-saturation across training stages — K3=K8 at s5k/50k/100k; ↵Yuren Hao
fixed-point bias (not truncation) grows; answers Alexi's more-nudges challenge Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15ERRATUM RESULT 21: original best 3.7117 was @104.8k not @185k — 90k-step ↵Yuren Hao
wall-1 plateau before the wall-2 blow; figure + deck rebuilt Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15RESULT 26: C512 ZERO-GAP SEALED — stage1b_cent 1.2334 vs BP 1.2311 ↵Yuren Hao
(+0.0023, inside seed band); the 0.050 gap was recipe/noise Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15External notes: sliding-mode clamping (Stage-0 injection rule), ↵Yuren Hao
saturated-unit EP-BPTT divergence (smooth-gate methods rule), momentum-bias unification with RESULT 22 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15assets/: organize into decks|figs|hw|refs|misc; scripts + gitignore repointedYuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15Alexi primer deck: 10 slides (arch op-by-op, EP phases, ↵Yuren Hao
schedule/parallelism, 72M blowup from real logs, loop-gain + beta-window hypotheses, diagnostics table, in-flight outcomes, $50k ladder) + figure scripts Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15centfast (doubled-batch +/-beta centered, cos 1.000000000 vs sequential, ↵Yuren Hao
DDP-verified) + est_late/est_late_at (tail-only centered); quiet bench: 1.72x -> 1.64x, est_late@80% -> ~1.13x amortized Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15RESULT 25: bias decomposition probe — 100% between-block transmission ↵Yuren Hao
(TRANS=EP 0.9987, ANCHOR=1.0000, K1=BP exactly, K3=K8 saturated) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-15RESULT 23 verdict: gap tracks FIT DEPTH not width — all registered ↵Yuren Hao
hypotheses falsified (C128 zero-gap at cos 0.805); fw72m_cent live at 1.95 it/s Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 24: fw72m_cent pre-registration (centered crown rerun, bcap-v3 0.9, ↵Yuren Hao
gradtest 0.9999877 gate passed, chained behind ladder) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 22 arms7 verdict (centered@3e-3 wins tail-SNR, momentum refuted) + ↵Yuren Hao
RESULT 23 gap-scaling pre-registration; ladder launched GPU1+GPU3 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14sync: add stage1b_bp_muon (42M BP twin) to TS project + report runsetYuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14sync: negative-cos regex fix, f3e3cont log mapping, SYNC_ID_SUFFIX; full ↵Yuren Hao
inventory verified green Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 21: crown sealed — 72.11M x 1.44B tokens fully BP-free (largest to ↵Yuren Hao
date), gen gate passed on FineWeb; casc_gen data-aware Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14wandb reorganized: per-regime team projects (ept-tinystories-42m / ↵Yuren Hao
ept-fineweb-72m), auto project routing in trainers, split replay + reports Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14wandb -> team entity eqprop-llm-training (trainers + full-history replay script)Yuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14bcap v2: absolute-scale gate on rho meter (fixes v1 noise-floor starvation), ↵Yuren Hao
gentler attack 0.85/floor 0.05; crown c2 relaunched from s215000 with cap armed Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 20: wall-zone verdicts — damping refuted (3 witnesses, monotone ↵Yuren Hao
spectrum), beta-down sails, bcap v1 starves (meter noise floor); crown completion + arms7 launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 19: wall-2 loop-gain theory, beta window formalism, probe ↵Yuren Hao
mid-verdicts, three new controllers Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14beta-cap-by-loop-gain controller (--beta_cap_rho): rho^ meter from sweep ↵Yuren Hao
residuals, cap OVERRIDES floor near the wall; smoke passed Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14Adaptive relax (--relax_tol): sweep-to-tolerance + rho-triggered geta ↵Yuren Hao
backtracking + final full-step graphed round (E-read identity fix: mixing leaked iteration residual into E, gn 1e5); kuse telemetry; paired smoke at wall ckpt: adaptive cos 0.771 vs legacy 0.754 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 18: wall-2 returns at 72M/FineWeb 195k (drift crossing, beta-stress ↵Yuren Hao
confirmed by f3e3); runs killed, geta fix probes launched from s195000 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
generated by cgit v1.2.3 (git 2.25.1) at 2026-08-18 17:23:24 +0000