summaryrefslogtreecommitdiff
path: root/RESULTS.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 06:57:24 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 06:57:24 -0500
commit94a90c664ff4ba60ff3cbe7327bd4a571c31f438 (patch)
treea490c227589cb3115cbbdcac3d9053c70e4bc980 /RESULTS.md
parent5d402d25c4f6805d9bfd6d2fcb452fc6c1ceb1ed (diff)
analysis: test the frozen depth-retention margin
Diffstat (limited to 'RESULTS.md')
-rw-r--r--RESULTS.md7
1 files changed, 7 insertions, 0 deletions
diff --git a/RESULTS.md b/RESULTS.md
index 29c3e33..7d60c4f 100644
--- a/RESULTS.md
+++ b/RESULTS.md
@@ -88,6 +88,13 @@ depth grows 12x and wall time grows 9.87x (geometric mean). Its paired gap to BP
3.69 and 4.35 points at every tested depth. Flattened CIFAR itself is depth-flat, so this establishes
preservation under depth, not a claim that extra depth improves the task.
+The `-1`-point retention margin was fixed in `experiments/finalize_claims.sh` before the missing
+depth cells were generated. A paired one-sided t-test rejects the null that SDIL's mean d5-to-d60
+change is at most `-1` point (`t(4)=5.030`, `p=0.0037`; one-sided 95% lower bound `-0.547`). The
+same complete analysis rejects that null for BP (`p=0.0359`) and FA (`p=0.0321`) but not DFA
+(`p=0.2310`; lower bound `-1.211`). This is an equivalence-to-the-prespecified-margin statement,
+not a post-hoc test that the depth change is exactly zero.
+
The mean-based nondominated frontier among local methods is DFA-d5 (`5.01 s`, `37.77%`), FA-d5
(`5.72 s`, `38.92%`), then SDIL-d5 (`9.84 s`, `41.46%`). BP is shown only as a nonlocal reference.
Thus SDIL occupies the high-accuracy end of the audited local-learning frontier; the deeper SDIL