summaryrefslogtreecommitdiff
path: root/notes
AgeCommit message (Collapse)Author
2026-06-13Add master technical reference; retire unverified e0 headlineYurenHao0426
Note 42 is a self-contained write-from document: full statements and proofs for Thm 1-4 / Prop 1-3 / Cor 1-2, every result with exact numbers and configs cross-checked against the CSVs, the negative results, and the honesty boundaries. Audit finding while building it: the "E_B[e0]=0.4378 +/- 0.008 vs 0.4403" headline (cited in notes 29/35/36/40/41 and the old draft) is not reproducible from the current moments CSV. Retired in favor of the reproducible 6x6 table (max |error| <= 0.008, predicted span 0.15-0.45). Living docs updated; note 37 sec 4 records the retirement. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-13Add prose style contract for the writing passYurenHao0426
Adapt the flossing project's anti-slop checklist to facap: keep the general layers (lexical bans, em-dash budget, density floor, Buschek integrity mapping) and replace the project-specific honesty rails with facap's (retired 0.977, no-fit definition, estimator scope, hard-k as null model only, inline assumptions, MNIST MAE-first, teacher gap as scoping evidence). Note 41 section 7 and the schedule now point at it. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09Organize repo and add AAAI-27 writing planYurenHao0426
Root README orients the repo; notes/README reindexed by status (writing pipeline / authoritative note per result / six historical phases with superseded markers); scripts/README gains a status table. Note 40 = reproduction manifest (claim -> command -> outputs -> note; everything unlisted is not citable). Note 41 = the binding paper plan: AAAI-27 constraints (7pp + refs, appendix not guaranteed read), narrative, section/page budget, frozen theorem and figure numbering, related-work list with per-cite rationale, writing rules, weekly schedule to the 07-20/07-27 deadlines, and risk register. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09Add teacher-task test-gap sweep and figureYurenHao0426
SGD teacher sweep (widths 8-96, 24 FA runs/width): train gap soft and monotone (0.249 -> 0.0069) while the test gap changes sign — FA generalizes better than BP at intermediate width (-0.120 +/- 0.013 at w=32) and settles slightly positive once both fit. Scopes the paper's optimization-gap claims and preempts the generalization question. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09Add MNIST real-data validation of e0 theorem and estimatorYurenHao0426
New script validates both no-fit claims on MNIST-subset MLPs. e0 theorem: 16 configs, hidden share 0.39-0.82, measured E_B[e0] within 0.0001-0.0089 of prediction (512 real-backward draws each). Estimator: 96 trajectories, velocity MAE 0.00196 (3.9% of mean gap), bias -0.0006, beating fixed K(0) everywhere; kernels computed via a layerwise gram identity self-tested against autograd at machine precision. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09Record evidence ledger and wrap-up correctionsYurenHao0426
Note 36 consolidates the full evidence chain (numbers, figure sources, negative results, claim discipline) as the paper-writing base; note 37 records the two audit fixes; superseded banners on notes 00/03; README index updated. Superseded alignment_recovery_dynamics probe removed. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-09Add closed-form soft-ramp theorem and matched comparisonYurenHao0426
Closed-form gap law note (34) + consolidated snapshot (35), with the comparison script reading the dense run's config/gaps from its output dir and evaluating the closed form on matched data and init seed plus a multi-init band. Corrected headline: corr(log,log) 0.933 matched / 0.982 five-init geometric mean; lam_min ensemble corr 0.987. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-06-07Add complete markdown draftYurenHao0426
2026-06-05Validate exact initial FA erosion distributionYurenHao0426
2026-06-05Test first order FA tangent hierarchyYurenHao0426
2026-06-05Review methods for FA operator dynamicsYurenHao0426
2026-06-05Derive actual FA initial operator momentYurenHao0426
2026-06-05Clarify proof and estimator statusYurenHao0426
2026-06-05Position Song Xu Lafferty related workYurenHao0426
2026-06-05Separate estimator from nonzero cost theoremYurenHao0426
2026-06-05Compare soft erosion theory distributionsYurenHao0426
2026-06-05Add effective capacity literature and gap theory noteYurenHao0426
2026-06-05Clarify soft erosion scaling claimYurenHao0426
2026-06-05Revise capacity theory to soft erosionYurenHao0426
2026-06-05Record dense soft capacity transitionYurenHao0426
2026-06-05Add phase transition trajectory zoom analysisYurenHao0426
2026-06-05Analyze phase transition training timeYurenHao0426
2026-06-05Add contribution roadmap and phase transition plotYurenHao0426
2026-06-05Record systematic low bias analysisYurenHao0426
2026-06-05Stress test early-kernel operator predictorYurenHao0426
2026-06-03Add early-kernel operator predictorYurenHao0426
2026-06-03Check directional predictor across NYurenHao0426
2026-06-03Probe early kernel predictorsYurenHao0426
2026-06-03Add time-varying kernel diagnosticYurenHao0426
2026-06-03Investigate finite-T kernel errorsYurenHao0426
2026-06-02Plan finite-time tangent extensionYurenHao0426
2026-06-02Record T5 local tangent validationYurenHao0426
2026-06-02Record fixed-width capacity probeYurenHao0426
2026-06-02Record short SGD tangent validationYurenHao0426
2026-06-02Replace transition theory with tangent capacityYurenHao0426
2026-06-02Add BP-calibrated transition theoryYurenHao0426
2026-06-02Record 256-trajectory transition analysisYurenHao0426
2026-06-01Add downstream capacity threshold validationYurenHao0426
2026-05-29Add trajectory gap distribution bridgeYurenHao0426
2026-05-29Add initialization coverage distribution matchingYurenHao0426
2026-05-29Add multilayer capacity distribution matchingYurenHao0426
2026-05-29Add large empirical capacity validationYurenHao0426
2026-05-28Add trajectory ensemble validationYurenHao0426
2026-05-28Add hidden gradient alignment metricYurenHao0426
2026-05-28Add synthetic FA trajectory validationYurenHao0426
2026-05-28Add functional capacity overlap simulationYurenHao0426
2026-05-28Add prior-free minimax initialization simulationYurenHao0426
2026-05-28Add capacity scaling calculationsYurenHao0426
2026-05-28Add static alignment beta validationYurenHao0426
2026-05-28Initialize project notesYurenHao0426