From 84fa70be406248e660488ddc4c56ca5ea0034189 Mon Sep 17 00:00:00 2001 From: YurenHao0426 Date: Tue, 9 Jun 2026 15:30:20 -0500 Subject: Add teacher-task test-gap sweep and figure MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit SGD teacher sweep (widths 8-96, 24 FA runs/width): train gap soft and monotone (0.249 -> 0.0069) while the test gap changes sign — FA generalizes better than BP at intermediate width (-0.120 +/- 0.013 at w=32) and settles slightly positive once both fit. Scopes the paper's optimization-gap claims and preempts the generalization question. Co-Authored-By: Claude Fable 5 --- notes/README.md | 4 ++++ 1 file changed, 4 insertions(+) (limited to 'notes/README.md') diff --git a/notes/README.md b/notes/README.md index 158a8c5..76d8e46 100644 --- a/notes/README.md +++ b/notes/README.md @@ -10,6 +10,10 @@ Use this directory as the project memory. Keep rough ideas here before promoting - [36_evidence_ledger.md](36_evidence_ledger.md): **the writing base** — full evidence chain, corrected headline numbers, figure sources, claim discipline. +- [38_mnist_real_data_validation.md](38_mnist_real_data_validation.md): e0 + theorem + estimator replicated on MNIST (no fit). +- [39_teacher_test_gap.md](39_teacher_test_gap.md): teacher-task test gap — + optimization cost invariant, test effect task-dependent (sign flip). - [37_wrapup_corrections.md](37_wrapup_corrections.md): pre-writing audit fixes (e0 sampler now real FA backward; closed-form comparison now data/init-matched — corr 0.977 retired, 0.933 matched / 0.982 ensemble). -- cgit v1.2.3