diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-11 16:41:19 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-11 16:41:19 -0500 |
| commit | bfdcc36c0e31adfa95410ce87e7da646e0b948fe (patch) | |
| tree | c486cd329fcb81d3019804dfed7f9551c6d43638 /scripts/run_dev.py | |
| parent | 112c5d354f36d6ea6e8049cf1aeaebeb9944aa02 (diff) | |
Crash-safe incremental saving: never lose data again
Major rewrite of run_all_methods.py:
- Each example appends to progress.jsonl immediately (crash-safe)
- per_user.json written after each method completes (not at end of script)
- Resume support: re-running skips already-complete methods, resumes
partially-complete ones from the JSONL checkpoint
- is_method_complete() checks existing per_user.json before running
Also includes previous fixes:
- peft_baseline.py: save original model ref, restore in cleanup()
- fit_theta.py: CHUNK_SIZE 128→32 for K=16 OOM fix
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'scripts/run_dev.py')
0 files changed, 0 insertions, 0 deletions