diff options
| author | Yuren Hao <yurenh2@illinois.edu> | 2026-07-12 12:41:03 -0500 |
|---|---|---|
| committer | Yuren Hao <yurenh2@illinois.edu> | 2026-07-12 12:41:03 -0500 |
| commit | 27cecb987fff1d6acd2f2e7bfaa7f8a01670bde5 (patch) | |
| tree | ba43431d70eca4168c8e2de8f34fb65d62ba6eda /docs | |
| parent | 97d2d5b9e9e9717748dbc023b2e3d459aede2299 (diff) | |
stage1b_amp epoch confirm SEALED: 1.2868 vs fp32 1.2808, zero guards, 1.56x held
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/campaign/CASCADE_ABLATION_PLAN.md | 7 |
1 files changed, 5 insertions, 2 deletions
diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md index d604fc6..3377dab 100644 --- a/docs/campaign/CASCADE_ABLATION_PLAN.md +++ b/docs/campaign/CASCADE_ABLATION_PLAN.md @@ -578,8 +578,11 @@ quantization (wall-1: beta-displacement below bf16 resolution) — exactly as di cos 0.9999 at step 0. Zero guard events. - SPEED (solo GPU3/A6000, C512): amp 2.785 it/s vs fp32 1.789 it/s = 1.56x wall-clock; grows with width (tensor-core-bound share) -> treat 1.5x as the floor for 1-3B on H100. -- CAVEAT + confirm step: 4k is short-horizon; stage1b_amp (58.8k full epoch, identical recipe+seed, - GPU1) running as the epoch-scale confirm vs 1.2808. EMAIL_BEN_DRAFT2 send-gate #6 waits on it. +- ~~CAVEAT + confirm step~~ **EPOCH CONFIRM SEALED (2026-07-12 late): stage1b_amp DONE best val + CE 1.2868 vs fp32 1.2808 (Δ+0.006, inside the 0.02-0.03 best-of-noisy-val band); zero guard + events over 58.8k; 2.80 vs ~1.79 it/s = the 1.56x held for the full epoch.** amp = Stage-2 + default, full confidence. EMAIL_BEN_DRAFT2 gate #6 CLEARED (the sent "validated this week" + claim is now closed at epoch scale). - Cost consequence: COST_MODEL.md v2.1 (sourced July-2026 prices: market H100 $1.87-2.99/GPU.h, AWS p5e blocks $4.97/GPU.h post-hike) — with amp measured, 3B-Chinchilla ~$40k / 7Bx20B ~$30k on AWS blocks: BOTH inside the $50k envelope individually. amp is the Stage-2 default. |