diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 05:11:34 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 05:11:34 -0500 |
| commit | 08876d84919b90b194ffdc3bb8c03633504f62da (patch) | |
| tree | b9620b2bb75b6a5cbcd4f4900d77d5cb8b930736 /ROADMAP.md | |
| parent | f5ade80071acab603bb90864bf94b6c0e091d12e (diff) | |
theory: prove estimator and innovation regimes
Diffstat (limited to 'ROADMAP.md')
| -rw-r--r-- | ROADMAP.md | 6 |
1 files changed, 6 insertions, 0 deletions
@@ -250,6 +250,12 @@ The minimum theory package contains: Numerical simulations must test the predicted scaling with depth, width, directions, perturbation scale, and predictor timescale. +**Status: passed on 2026-07-22.** `THEORY.md` gives the exact simultaneous-Rademacher MSE with its +cross-layer term, the Gaussian layerwise comparison, an `O(sigma^2)` antithetic bias bound, the +smooth-loss angle/gain/curvature descent condition, the neutral innovation/SNR theorem and +task-fit absorption result, and a phase/query/work/memory table. `experiments/verify_theory.py` +checks depth, width, K, sigma, and predictor timescale deterministically; all assertions pass. + ## Protocol discipline - Hyperparameters are selected on a validation split created only from the training set. |
