summaryrefslogtreecommitdiff
path: root/RESULTS.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 12:19:44 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 12:19:44 -0500
commit9763a8ecf4d614370cfde3ff926c5070ab766433 (patch)
tree4ed0b067bfcf4a16f811f37b5723d728ffb5db74 /RESULTS.md
parent04de9326e60bb9e3592c0ddb5474265d228cbce0 (diff)
baselines: complete native author-code audit
Diffstat (limited to 'RESULTS.md')
-rw-r--r--RESULTS.md19
1 files changed, 19 insertions, 0 deletions
diff --git a/RESULTS.md b/RESULTS.md
index 5ef402a..6b11b34 100644
--- a/RESULTS.md
+++ b/RESULTS.md
@@ -586,6 +586,25 @@ strong modern EP variant remains necessary. DFA is also strong on easy MNIST, so
comes from the five-depth CIFAR panel; this comparison establishes that SDIL need not trade away
accuracy to obtain a large cost advantage over canonical EP.
+### Native author-code CIFAR-10 baselines
+
+These are executable-fidelity reproductions under the authors' architectures
+and schedules, not equal-compute comparisons with SDIL:
+
+| method | reproduced seed | primary test (%) | validation-selected test (%) | test-selected test (%) | published (%) | audited wall (s) |
+|:--|--:|--:|--:|--:|--:|--:|
+| BurstCCN | 0 | 80.070 | 80.100 | 80.250 | 82.97 +/- 0.21 | 15451.3 |
+| Dual Prop | 1988 | 92.460 | 92.460 | n/a | 92.41 +/- 0.07 | 23119.8 |
+
+BurstCCN's primary value is the final epoch and its best-test value is
+test-selected because native code evaluates test every epoch. Dual Prop
+restores the best-validation checkpoint and evaluates test once, so primary
+and validation-selected values coincide. Both strict records include source,
+environment, dataset, artifact, selection, and wall-definition audits. Dual
+Prop reproduces its published accuracy almost exactly, but uses VGG16 with 16
+nudged inference passes and about 6.42 hours of author-measured compute on a
+GTX 1080.
+
### Frozen standard-ResNet development funnel
The prospective Oral-A funnel used a 45k/5k training-only CIFAR-10 split; no