ept.git - Unnamed repository; edit this file 'description' to name the repository.

Age	Commit message (Collapse)	Author
2026-07-10	OLMo2-standard architecture (user directive): norm-after-sublayer RMSNorm ↵	Yuren Hao
	blocks, full-width QK-norm, RoPE(500k), SwiGLU, no-bias, untied head, final RMSNorm, 0.02 init, grouped wd, optional z-loss (plumbed through nudge+readout+gate for EP exactness); EP smoke 42.75M cos=1.0000 Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10	AUDIT: retract confounded Muon verdict; tone down parity claims (n=3, ↵	Yuren Hao
	best-of-noisy-val); scope depth-tax claim to 4k horizon; guard-split skip telemetry (skd/skg); add BP control arm diag_D_bp (+--resume in BP trainer); record resume confounds Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-10	Stage-1 epoch blowup @12100: sig story REFUTED (only +8%, cos fine till ↵	Yuren Hao
	after); leading indicator=drift-guard skips -> contractivity bifurcation in nudged relaxation (cascade Hopf wall); add resume/sig0/final_ln; A/B/C diagnostic launched
2026-07-10	QK-norm: replace nn.MHA with explicit SDPA attn + --qk_norm (OLMo2-style, ↵	Yuren Hao
	analog-friendly); cancel epoch, insert 8-run qk validation, stage roadmap TinyStories-epoch->FineWeb-Edu->OLMo2
2026-07-10	Add --cosine (warmup->cosine decay to 0.1x lr) to both cascade trainers for ↵	Yuren Hao
	full-epoch runs
2026-07-09	A0.4 precision gate (TF32 harmless cos 0.9946==fp32; pure-bf16 cos 0.9427) + ↵	Yuren Hao
	Muon hybrid optimizer (--opt muon) wired into both trainers; D1a flagship matrix launched (L12xC512, 3xBP + 3xEP + Muon arms) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09	cascade root cause found: tied readout + default N(0,1) embedding init = ↵	Yuren Hao
	pathological top-CE stiffness once predictions sharpen (sigma_tok~76 vs GPT-standard 0.02 giving ~1.6); add --untie and --tok_init; diag arms A/B/C Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
2026-07-09	cascade ablation program: plan doc (5 claims, tiers 0-4), probe v2 ↵	Yuren Hao
	(jacobi/gsf/gsr schemes, full-theta gate, multi-batch), casc_bp_train ckpt producer Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn