summaryrefslogtreecommitdiff
path: root/docs/campaign/CASCADE_ABLATION_PLAN.md
diff options
context:
space:
mode:
authorYuren Hao <yurenh2@illinois.edu>2026-07-14 13:21:35 -0500
committerYuren Hao <yurenh2@illinois.edu>2026-07-14 13:21:35 -0500
commitb6d44e395f255979bec2ca091bb40a5064bf54ca (patch)
tree9f01356d62060a9dca03f40ae328dd4ee8b70dea /docs/campaign/CASCADE_ABLATION_PLAN.md
parent836e72a707de4f8bd7679400cb40fe59464daca9 (diff)
RESULT 21: crown sealed — 72.11M x 1.44B tokens fully BP-free (largest to date), gen gate passed on FineWeb; casc_gen data-aware
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'docs/campaign/CASCADE_ABLATION_PLAN.md')
-rw-r--r--docs/campaign/CASCADE_ABLATION_PLAN.md13
1 files changed, 13 insertions, 0 deletions
diff --git a/docs/campaign/CASCADE_ABLATION_PLAN.md b/docs/campaign/CASCADE_ABLATION_PLAN.md
index e8b23a4..d59a47d 100644
--- a/docs/campaign/CASCADE_ABLATION_PLAN.md
+++ b/docs/campaign/CASCADE_ABLATION_PLAN.md
@@ -567,6 +567,19 @@ direction), not training-under-fault; wave-2 = co-training with faults injected
+
+### RESULT 21 (2026-07-14): CROWN SEALED — 72.11M x 1.44B tokens, fully BP-free, largest to date.
+fw72m_c2 reached 234,000 steps = the full Chinchilla budget (segments: 0-195k original schedule +
+195-215k blow-recipe + 215-234k bcap-v2; final segment skips=1, drift 0.016 — the wall managed).
+**Best model: val CE 3.7117 (s185000, ~1.13B tokens) vs BP twin 3.2884 -> headline gap ~0.43**
+(disclosed as un-recalibrated transfer; mechanism = beta window, RESULT 19/20). "NENG-KAN" GATE
+PASSED on FineWeb register: fluent, on-topic, syntactic English (factual coherence not expected at
+72M on open web; BP twin equally confused). CLAIM NOW LIVE: **the largest neural network fully
+trained without backpropagation to date (72.11M > KHS 62.7M), and the first transformer LM at that
+scale** — crown + first stack together. Samples: runs/fw72m_samples.txt; gen tool now data-aware.
+wandb: team eqprop-llm-training, split projects (ept-tinystories-42m / ept-fineweb-72m) + reports;
+workspace default-visibility gotcha (newest-10) fixed by replaying headline runs last.
+
### RESULT 20 (2026-07-14): WALL-ZONE PROBE VERDICTS — damping REFUTED (2 doses + adapt), beta-down SAILS; crown completion launched.
Six arms, s195000 -> 201000 (the full crossing zone), identical data/recipe otherwise:
| arm | val@201k (best) | skips | drift@end | verdict |