summaryrefslogtreecommitdiff
path: root/results/native_baseline_audit.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 12:19:44 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-22 12:19:44 -0500
commit9763a8ecf4d614370cfde3ff926c5070ab766433 (patch)
tree4ed0b067bfcf4a16f811f37b5723d728ffb5db74 /results/native_baseline_audit.md
parent04de9326e60bb9e3592c0ddb5474265d228cbce0 (diff)
baselines: complete native author-code audit
Diffstat (limited to 'results/native_baseline_audit.md')
-rw-r--r--results/native_baseline_audit.md24
1 files changed, 24 insertions, 0 deletions
diff --git a/results/native_baseline_audit.md b/results/native_baseline_audit.md
new file mode 100644
index 0000000..73262db
--- /dev/null
+++ b/results/native_baseline_audit.md
@@ -0,0 +1,24 @@
+# Native author-code baseline audit
+
+Both records passed the strict C4 artifact, source, protocol, environment,
+dataset, completeness, finiteness, selection, and cost-definition checks.
+These are method-native reproductions, not equal-compute comparisons with SDIL.
+
+| method | reproduced seed | primary test (%) | validation-selected test (%) | test-selected test (%) | published (%) | audited wall (s) |
+|:--|--:|--:|--:|--:|--:|--:|
+| BurstCCN | 0 | 80.070 | 80.100 | 80.250 | 82.97 ± 0.21 | 15451.3 |
+| Dual Prop | 1988 | 92.460 | 92.460 | — | 92.41 ± 0.07 | 23119.8 |
+
+BurstCCN's primary metric is its final epoch. Its validation-selected metric is
+the test accuracy from the minimum-validation-error epoch; its best test value
+is explicitly test-selected because the native trainer evaluates test every
+epoch. The `n_epochs=400` author configuration performs an epoch-0 evaluation
+and 399 optimization epochs. Dual Prop evaluates test once after restoring the
+best-validation checkpoint, so its primary and validation-selected values are
+identical and no test-selected value exists.
+
+The BurstCCN wall value is W&B run time through the final epoch log. The Dual
+Prop wall value sums author-measured train, validation, and final test time and
+excludes setup, checkpoint I/O, and diagnostic plotting. One reproduced seed
+establishes executable fidelity; published multi-seed uncertainty is retained
+for context and is not replaced by a one-seed error bar.