From 94a90c664ff4ba60ff3cbe7327bd4a571c31f438 Mon Sep 17 00:00:00 2001 From: YurenHao0426 Date: Wed, 22 Jul 2026 06:57:24 -0500 Subject: analysis: test the frozen depth-retention margin --- RESULTS.md | 7 +++++++ 1 file changed, 7 insertions(+) (limited to 'RESULTS.md') diff --git a/RESULTS.md b/RESULTS.md index 29c3e33..7d60c4f 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -88,6 +88,13 @@ depth grows 12x and wall time grows 9.87x (geometric mean). Its paired gap to BP 3.69 and 4.35 points at every tested depth. Flattened CIFAR itself is depth-flat, so this establishes preservation under depth, not a claim that extra depth improves the task. +The `-1`-point retention margin was fixed in `experiments/finalize_claims.sh` before the missing +depth cells were generated. A paired one-sided t-test rejects the null that SDIL's mean d5-to-d60 +change is at most `-1` point (`t(4)=5.030`, `p=0.0037`; one-sided 95% lower bound `-0.547`). The +same complete analysis rejects that null for BP (`p=0.0359`) and FA (`p=0.0321`) but not DFA +(`p=0.2310`; lower bound `-1.211`). This is an equivalence-to-the-prespecified-margin statement, +not a post-hoc test that the depth change is exactly zero. + The mean-based nondominated frontier among local methods is DFA-d5 (`5.01 s`, `37.77%`), FA-d5 (`5.72 s`, `38.92%`), then SDIL-d5 (`9.84 s`, `41.46%`). BP is shown only as a nonlocal reference. Thus SDIL occupies the high-accuracy end of the audited local-learning frontier; the deeper SDIL -- cgit v1.2.3