diff options
| author | Yuren Hao <yurenh2@illinois.edu> | 2026-07-15 05:34:27 -0500 |
|---|---|---|
| committer | Yuren Hao <yurenh2@illinois.edu> | 2026-07-15 05:34:27 -0500 |
| commit | bf83f39828fb79428fe65fe0fef49768351afc05 (patch) | |
| tree | 4b26bef0e72de0da32b8f3a2c22f62f527b82436 /ep_run/prepare_fineweb.py | |
| parent | d0268c2f2ba7a1ceb5125f19b5f3b7dd61eb99eb (diff) | |
centfast (doubled-batch +/-beta centered, cos 1.000000000 vs sequential, DDP-verified) + est_late/est_late_at (tail-only centered); quiet bench: 1.72x -> 1.64x, est_late@80% -> ~1.13x amortized
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'ep_run/prepare_fineweb.py')
0 files changed, 0 insertions, 0 deletions