summaryrefslogtreecommitdiff
path: root/scripts
AgeCommit message (Collapse)Author
26 hoursprepare_data: hard-exit after DONE — HF streaming prefetch threads hang ↵HEADmainYurenHao0426
interpreter shutdown after break Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
27 hoursprepare_data: write .partial then rename, so interrupted prep can't leave a ↵YurenHao0426
half train.bin that gets mistaken for complete Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
31 hoursrevert collaborator auto-push flow; results come back manually (scp/drive), ↵YurenHao0426
no credentials on node Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
31 hourszero-token collaborator flow: deploy-key quickstart + auto results push ↵YurenHao0426
(PUSH_RESULTS) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursHF upload tooling: env-only auth, scoped-token guidance, optional ladder ↵yurenh
auto-upload Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursresults flow: collect.py (node-side bundle) + plot_ladder.py (gap-vs-scale ↵yurenh
analysis) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursenv bootstrap (optional venv) + self-check in the ladder runneryurenh
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursladder runner: SET override passthrough; validated end-to-endyurenh
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursadd zbp_n64 train config; guard missing configs in the ladder runneryurenh
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursone-click resume-safe ladder runner (env-configurable)yurenh
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursdata prep (FineWeb-Edu->GPT2 BPE), rho diagnostics, tests, measured-cost notesyurenh
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe
32 hoursscaffold: model (OLMo2-ish + ZBP partition), trainer (DDP/config), data ↵yurenh
shards, bench Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01GkgLsACEF6CCP7EUfA5fZe