summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2026-07-15RESULT 23 verdict: gap tracks FIT DEPTH not width — all registered ↵Yuren Hao
hypotheses falsified (C128 zero-gap at cos 0.805); fw72m_cent live at 1.95 it/s Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 24: fw72m_cent pre-registration (centered crown rerun, bcap-v3 0.9, ↵Yuren Hao
gradtest 0.9999877 gate passed, chained behind ladder) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 22 arms7 verdict (centered@3e-3 wins tail-SNR, momentum refuted) + ↵Yuren Hao
RESULT 23 gap-scaling pre-registration; ladder launched GPU1+GPU3 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14sync: add stage1b_bp_muon (42M BP twin) to TS project + report runsetYuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14sync: negative-cos regex fix, f3e3cont log mapping, SYNC_ID_SUFFIX; full ↵Yuren Hao
inventory verified green Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 21: crown sealed — 72.11M x 1.44B tokens fully BP-free (largest to ↵Yuren Hao
date), gen gate passed on FineWeb; casc_gen data-aware Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14wandb reorganized: per-regime team projects (ept-tinystories-42m / ↵Yuren Hao
ept-fineweb-72m), auto project routing in trainers, split replay + reports Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14wandb -> team entity eqprop-llm-training (trainers + full-history replay script)Yuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14bcap v2: absolute-scale gate on rho meter (fixes v1 noise-floor starvation), ↵Yuren Hao
gentler attack 0.85/floor 0.05; crown c2 relaunched from s215000 with cap armed Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 20: wall-zone verdicts — damping refuted (3 witnesses, monotone ↵Yuren Hao
spectrum), beta-down sails, bcap v1 starves (meter noise floor); crown completion + arms7 launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 19: wall-2 loop-gain theory, beta window formalism, probe ↵Yuren Hao
mid-verdicts, three new controllers Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14beta-cap-by-loop-gain controller (--beta_cap_rho): rho^ meter from sweep ↵Yuren Hao
residuals, cap OVERRIDES floor near the wall; smoke passed Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14Adaptive relax (--relax_tol): sweep-to-tolerance + rho-triggered geta ↵Yuren Hao
backtracking + final full-step graphed round (E-read identity fix: mixing leaked iteration residual into E, gn 1e5); kuse telemetry; paired smoke at wall ckpt: adaptive cos 0.771 vs legacy 0.754 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-14RESULT 18: wall-2 returns at 72M/FineWeb 195k (drift crossing, beta-stress ↵Yuren Hao
confirmed by f3e3); runs killed, geta fix probes launched from s195000 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13Estimator arms machinery: --est centered/richardson (two-pass, O(b^2) bias), ↵Yuren Hao
--muon_mom/--adam_b1 knobs; smoke passed (resume+centered cos 0.998) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13Fix swallowed --wandb_run arg (replace-comment bug); wandb default-on intactYuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13wandb ON by default in both trainers (project ept-cascade); BP twin gains ↵Yuren Hao
--amp; fw72m_bp launched GPU1 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13TinyEP hostile audit archived: DEAD per own claim class, SURVIVES-DEGRADED ↵Yuren Hao
rescoped; portable gold = tied-KV DenseAM energy + same-cell bidirectional access Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13Intercept: Shanbhag draft A superseded — die modes answered NO on ↵Yuren Hao
published record, ask inverted Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13M-scale supply-chain down-select (20-agent): null demolished (UIUC die modes ↵Yuren Hao
= NO on published record), T64 MDAC winner, grade ceiling B-, claim ruling + GPT TinyEP proposal archived Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-1318-agent adversarial substrate down-select: incumbent CONFIRMED-MODIFIED ↵Yuren Hao
(-260), step-0 fault gates, refined partner asks Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13fw72m crown run launched (NCCL DDP prod), exact resume (opt state), RESULT ↵Yuren Hao
17, shuffle+prep scripts Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13Manual DDP for cascade-EP: guard-synced (drift/kretry via global max, gn on ↵Yuren Hao
reduced grads), sigma broadcast, per-rank data RNG, None-preserving flat all-reduce, bitwise param sync-check, grad-equivalence test PASSED (cos 0.999999999 vs single-GPU big batch) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13RESULT 16: FineWeb-Edu pipeline live + smoke passed (CE 10.5->5.8, cos ↵Yuren Hao
0.9995, zero skips) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-13Stage-2 data pipeline: FineWeb-Edu sample-10BT -> 32k BPE -> bins; --data ↵Yuren Hao
flag on both trainers Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12stage1b_amp epoch confirm SEALED: 1.2868 vs fp32 1.2808, zero guards, 1.56x heldYuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12Draft 7: reply to Ben's Overleaf-comments email (slop critique accepted, ↵Yuren Hao
two-papers class-boundary framing) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12Outreach signature resolved: name only, no titleYuren Hao
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12Hardware outreach v2: gate lifted, clockless-MVP story, Dillavou wave-1, ↵Yuren Hao
brief rewritten to cascade-era Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12RESULT 15 (amp lossless 1.56x) + COST_MODEL v2.1 (sourced July-2026 prices, ↵Yuren Hao
EF unit fix) + Draft 6 cost/scale rewrite Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12bf16 mixed-precision (--amp): gate PASSED (cos 0.9682 vs fp32 0.9687), ↵Yuren Hao
trainer flag + 3-seed 4k A/B launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12E-tier wave-1 ledger (RESULT 14 + HW map rows) + cost model v2 recalibrated ↵Yuren Hao
on measured H200 datapoint Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-12RESULT 13: bsign neutral at 4k (1.7382 vs 1.7314); 42M gap-chasing closed at ↵Yuren Hao
noise floor; pivot to Stage-2 pipeline + E-tier
2026-07-11RESULT 12: f3e3cont negative (1.2883 vs 1.2808) — residual gap not ↵Yuren Hao
beta-liftable; next lever = random-sign beta (single-phase, KHS-validated), then centered
2026-07-11Draft 6: formulation correction conceded precisely; ↵Yuren Hao
same-gradient-different-algorithms answer with the two resolvents; note attached; scope concession (MLP/CNN/RNN)
2026-07-11Draft 5 FINAL: post-quick-reply follow-up shape (Overleaf link + gap ledger ↵Yuren Hao
+ 3.2x calibrated against their 18-day App B + cost table + analog hook + two-papers ask) + send checklist
2026-07-11STANDING: looped line abandoned (user directive) — cascade-only default; ↵Yuren Hao
looped = historical data for dynamics paper
2026-07-11Their VGG10 = 62.7M (computed from Table 6) > our 42.75M: largest-today is ↵Yuren Hao
theirs; their EP/BP wall-clock 6.7-12x vs our 3.2x recorded as solver differentiator
2026-07-11Ben draft 5: engages 2606.03584 directly (Eq.10==our objective; ↵Yuren Hao
AsymEP-reduces-to-vanilla answer; mod-PGD convergence; their beta one-liner -> our quantified SNR); claim rescoped to first-transformer-LM; hardware paragraph tied to their open question
2026-07-11CLAIM RESCOPE: Kerjan-Hoier-Scellier PCN-ImageNet (their Eq.10 == our ↵Yuren Hao
cascade energy; 1.0-1.5pp gap remains) — 'largest NN today' contested, use largest-transformer/first-LM/zero-gap; 1B+ unqualified
2026-07-11Ben draft 4: academic register (metaphors stripped per user style ↵Yuren Hao
correction); register-split rule recorded in style profile
2026-07-11Ben draft 3.1: closing paragraph = split-vs-merge strategic ask (our lean: ↵Yuren Hao
two papers, capstone at 'the broadest venue the result can carry' — Nature unspoken)
2026-07-11Ben draft 3: largest NN (not LM), no cascade internals, gap-vs-no-gap as ↵Yuren Hao
headline, 3B-Chinchilla/7-8B earn-the-conversation framing, analog-LM plan hook for Rain
2026-07-11Ben reply draft 2: news block (largest fully BP-free LM, parity, Muon ↵Yuren Hao
transfer) + measured cost table + calibration pilot + envelope questions
2026-07-11RESULT 11: stage1b sealed (gap 0.050); beta ceiling unfound (3e-3 -> cos ↵Yuren Hao
0.9974); K exonerated on OLMo2; bf16 naive-cast dead at any beta (TF32 stays cost baseline); f3e3 CE-endpoint cont launched Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-11Component->analog-hardware map: full stack (forward path A.1-10, training ↵Yuren Hao
machinery B.11-17, cross-cutting physics C, demo scoping D) with reuse sources, feedback-path costs, tolerance status per item
2026-07-11Claim-verification dossier: largest-NN-without-BP — competitor autopsy ↵Yuren Hao
(optical DFA partial+BP-readout; EGGROLL from-scratch=tiny integer GRU; ES=finetune-only); claim holds at 42.75M with qualifier, unqualified at 1B+ Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-11Lock outreach headline (largest BP-free NN ever, analog-compatible) + reply ↵Yuren Hao
gating on stage1b+bf16
2026-07-11gitignore the token-bearing demo notebookYuren Hao
2026-07-10Queue: double-sided nudge after stage1b (0.22 = differential-measurement SNR ↵Yuren Hao
tax, escalation ladder recorded)
generated by cgit v1.2.3 (git 2.25.1) at 2026-08-18 19:23:19 +0000