diff options
| author | Yuren Hao <yurenh2@illinois.edu> | 2026-07-21 11:50:39 -0500 |
|---|---|---|
| committer | Yuren Hao <yurenh2@illinois.edu> | 2026-07-21 11:50:39 -0500 |
| commit | 2a14f8ddc9821e6ce192021042d1c7c839bf0b00 (patch) | |
| tree | fa788a2e8a6d32a14dd8116b1ec11183dc9d104a /docs | |
| parent | 014150378d8e8cd90c2b1a01d02a2f860379dbd5 (diff) | |
BASELINE_SPEC: 首任务=72M BP seeds 2/3(诚实gap分母,exact config给出); BP线全权移交协作者(本地bp_s2已撤,GPU全转EP)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/BASELINE_SPEC.md | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/docs/BASELINE_SPEC.md b/docs/BASELINE_SPEC.md index 5c5abc5..7c310b8 100644 --- a/docs/BASELINE_SPEC.md +++ b/docs/BASELINE_SPEC.md @@ -24,6 +24,13 @@ data/ckpts). 5000` (probes need the ladder). Results go into `docs/campaign/CASCADE_ABLATION_PLAN.md` as a RESULT entry (see existing entries for the format) + wandb. +## First task (warm-up, closes an open hole) + +The 72M BP twin is n=1 (best 3.2884, seed 1). Run seeds 2 and 3 with the exact original +config (`--L 12 --C 512 --H 8 --T 256 --B 24 --lr 1e-3 --opt muon --cosine --steps 234000 +--warmup 1000 --olmo2 --wd 0.1 --amp --save_every 5000`, seeds 2/3) — ~11-13h each on one +H100/A6000-class GPU. This sets the honest-gap denominator for every 72M claim. + ## Optional second baseline (sanity, not twin) A standard-recipe reference (AdamW β=(0.9,0.95), wd 0.1, cosine, GPT init) on the same |