diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 12:19:44 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 12:19:44 -0500 |
| commit | 9763a8ecf4d614370cfde3ff926c5070ab766433 (patch) | |
| tree | 4ed0b067bfcf4a16f811f37b5723d728ffb5db74 /ROADMAP.md | |
| parent | 04de9326e60bb9e3592c0ddb5474265d228cbce0 (diff) | |
baselines: complete native author-code audit
Diffstat (limited to 'ROADMAP.md')
| -rw-r--r-- | ROADMAP.md | 20 |
1 files changed, 11 insertions, 9 deletions
@@ -272,15 +272,17 @@ competitive under the frozen protocol. Each method receives a documented validation budget. Native-protocol and exact-architecture comparisons are labelled separately; neither substitutes for a matched compute/query comparison. -**Status: in progress.** In-repository BP/FA/DFA, direct NP, learned NP, PEPITA, -Forward-Forward, and canonical EP are complete. `BASELINES.md` freezes the author revisions, -commands, data provenance, and selection semantics for BurstCCN and Dual Prop. Paper-faithful -BurstCCN seed 0 is running on GPU5; author-code Dual Prop VGG16 seed 1988 is running on GPU7 after -a complete one-epoch smoke. C4 remains incomplete until both long runs finish and their artifacts -are imported and audited. The native protocol ledger, strict importer, result aggregator, and -`finalize_accept.sh` gate are frozen before either endpoint is observed. C4 does not impose an -accuracy threshold: poor faithful reproductions remain reportable and cannot be discarded, while -published multi-seed values remain explicitly separate from the one-seed executable-fidelity runs. +**Status: passed on 2026-07-22.** In-repository BP/FA/DFA, direct NP, learned NP, +PEPITA, Forward-Forward, and canonical EP are complete. Paper-faithful BurstCCN +seed 0 reaches `80.07%` final / `80.10%` validation-selected / `80.25%` +test-selected accuracy in `15451.3 s`, versus published `82.97 +/- 0.21%`. +Author-code Dual Prop VGG16 seed 1988 reaches `92.46%` from the best-validation +checkpoint in `23119.8 s`, versus published `92.41 +/- 0.07%`, with one test +evaluation. Both records pass artifact, source, environment, dataset, +completeness, finiteness, selection, and cost-definition checks in +`finalize_accept.sh`. These one-seed method-native reproductions remain +separate from matched-compute comparisons and from published multi-seed +uncertainty. ### C5. Theory predicts the observed regimes |