From 9763a8ecf4d614370cfde3ff926c5070ab766433 Mon Sep 17 00:00:00 2001 From: YurenHao0426 Date: Wed, 22 Jul 2026 12:19:44 -0500 Subject: baselines: complete native author-code audit --- ROADMAP.md | 20 +++++++++++--------- 1 file changed, 11 insertions(+), 9 deletions(-) (limited to 'ROADMAP.md') diff --git a/ROADMAP.md b/ROADMAP.md index ee71db8..e2dd375 100644 --- a/ROADMAP.md +++ b/ROADMAP.md @@ -272,15 +272,17 @@ competitive under the frozen protocol. Each method receives a documented validation budget. Native-protocol and exact-architecture comparisons are labelled separately; neither substitutes for a matched compute/query comparison. -**Status: in progress.** In-repository BP/FA/DFA, direct NP, learned NP, PEPITA, -Forward-Forward, and canonical EP are complete. `BASELINES.md` freezes the author revisions, -commands, data provenance, and selection semantics for BurstCCN and Dual Prop. Paper-faithful -BurstCCN seed 0 is running on GPU5; author-code Dual Prop VGG16 seed 1988 is running on GPU7 after -a complete one-epoch smoke. C4 remains incomplete until both long runs finish and their artifacts -are imported and audited. The native protocol ledger, strict importer, result aggregator, and -`finalize_accept.sh` gate are frozen before either endpoint is observed. C4 does not impose an -accuracy threshold: poor faithful reproductions remain reportable and cannot be discarded, while -published multi-seed values remain explicitly separate from the one-seed executable-fidelity runs. +**Status: passed on 2026-07-22.** In-repository BP/FA/DFA, direct NP, learned NP, +PEPITA, Forward-Forward, and canonical EP are complete. Paper-faithful BurstCCN +seed 0 reaches `80.07%` final / `80.10%` validation-selected / `80.25%` +test-selected accuracy in `15451.3 s`, versus published `82.97 +/- 0.21%`. +Author-code Dual Prop VGG16 seed 1988 reaches `92.46%` from the best-validation +checkpoint in `23119.8 s`, versus published `92.41 +/- 0.07%`, with one test +evaluation. Both records pass artifact, source, environment, dataset, +completeness, finiteness, selection, and cost-definition checks in +`finalize_accept.sh`. These one-seed method-native reproductions remain +separate from matched-compute comparisons and from published multi-seed +uncertainty. ### C5. Theory predicts the observed regimes -- cgit v1.2.3