diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 17:28:47 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 17:28:47 -0500 |
| commit | 24e299161c6040f64ace6181c1ee1c543851eff1 (patch) | |
| tree | eca323a185c20083648eb56bd5b86f7b5eaebbbc /REVIEW_SCORECARD.md | |
| parent | d945c4213e57135c53bc18ed9811c7a61f1f761a (diff) | |
docs: record dynamic projection stability and short pass
Diffstat (limited to 'REVIEW_SCORECARD.md')
| -rw-r--r-- | REVIEW_SCORECARD.md | 14 |
1 files changed, 10 insertions, 4 deletions
diff --git a/REVIEW_SCORECARD.md b/REVIEW_SCORECARD.md index 5443510..4257ac3 100644 --- a/REVIEW_SCORECARD.md +++ b/REVIEW_SCORECARD.md @@ -25,9 +25,9 @@ Every formal result report records: | Soundness | 3/4 | Theory, local-gradient checks, causal diagnostics, cost accounting, and frozen stop rules are unusually careful. The learned apical vectorizer remains an unresolved failure mode. | | Novelty | 2/4 | Learned node-perturbation feedback is prior art. The defensible novelty is the per-cell innovation operation under mixed apical traffic, together with its causal and scaling analysis. | | Significance | 3/4 | Near-flat performance over 12x depth while DFA alignment collapses is potentially important, but the current flattened-CIFAR task does not benefit from depth and the frozen standard-ResNet recipe failed. | -| Empirical support | 2/4 | Five-depth scaling and the residualization ablation are strong. Useful-depth C2, broad endogenous C1, oral-B, full ResNet A3, and KP mixed-traffic MT-1 gates failed; untouched confirmation panels correctly remained sealed. | +| Empirical support | 2/4 | Five-depth scaling and the residualization ablation are strong. Dynamic neutral projection now passes one standard-ResNet short validation gate, but useful-depth C2, broad endogenous C1, oral-B, full ResNet A3, and the original KP mixed-traffic MT-1 gates failed; full D3 and confirmation remain open. | | Reproducibility | 4/4 | Code, exact provenance, seed panels, costs, failed branches, frozen selectors, and staged test-access rules are retained in git. | -| **Overall** | **5/10** | **Borderline reject: a strong core result without a completed standard-scale or useful-depth demonstration.** | +| **Overall** | **5/10** | **Borderline reject: a strong core plus a promising short standard-scale result, but no completed full or independently confirmed endpoint.** | | Confidence | 4/5 | High confidence in the assessment because the positive and negative branches are both extensively audited. | ### Evidence already carrying the paper @@ -48,8 +48,9 @@ Every formal result report records: supported mechanism is narrower than the initial claim. 4. The frozen oral-B screen falsified the desired-velocity and Harnett error-derivative claims. 5. The frozen ResNet-20 A3 run became nonfinite and ended at chance; the later KP mixed-traffic - MT-1 panel also became nonfinite under all three signals. A4, MT-2, and MT-3 remain sealed, so - completed native baselines improve fairness but do not supply SDIL scale evidence. + MT-1 panel also became nonfinite under all three signals. Dynamic neutral projection repairs a + 20-epoch seed-0 validation run, but its full D3 endpoint and independent confirmation are not + complete. A4, MT-2, and MT-3 remain sealed. ## Score trajectory and prospective gates @@ -73,6 +74,9 @@ Every formal result report records: | Mixed-traffic MT-1 fails | 5 | Raw, norm-matched raw, and innovation all become nonfinite in epoch 1 and end at 10%; calibration and predictor warmup still pass | Closes the controlled standard-ResNet innovation path; MT-2/MT-3 remain untouched and no weaker traffic rescue is allowed | | Mixed-traffic MT-2 | not opened | The prerequisite MT-1 gate failed | No full seed-0 validation claim is available | | Mixed-traffic MT-3 | not opened | MT-2 was never opened; all five confirmation seeds remain untouched | No controlled ResNet innovation confirmation claim is available | +| Dynamic projection D1 | 5 | All 352 training-only steps remain finite while the fast neutral fit holds residual coupling near zero | Mechanics only; no held-out endpoint | +| Dynamic projection D2 | 5 | One frozen 20-epoch record reaches 83.58%, above clean KP's 82.66%, with all stability and cost gates passing | Short single-seed validation cannot establish the full scaling claim | +| Dynamic projection D3 | running | A predeclared 200-epoch near-BP validation gate is open | Only a complete pass can make 6/10 eligible and open confirmation | | Oral-A A4 | not opened | The prerequisite A3 gate failed | No oral-A confirmation claim is available | These are conditional reviewer forecasts, not promised scores. A failed stage leaves its negative @@ -104,6 +108,8 @@ retroactively reopened by success on standard vision benchmarks. | 2026-07-22 / `f310ad5` mixed-traffic MT-1 | All three frozen conditions become nonfinite in epoch 1 and end at 10%; ratio calibration, predictor warmup, zero-query, and cost checks pass | 5 → 5 | Fails to make innovation load-bearing on a standard ResNet and closes MT-2/MT-3; the prior mechanism-only evidence survives but empirical support does not improve | | 2026-07-22 / `6531aed`, `d818fc2` MT-1 diagnosis | Training-only localization finds the first active failure at stem steps 23/69/74 for raw/matched/innovation; residual coupling yields the verified multiplicative operator `D W C` | 5 → 5 | Sharpens the failure into an operator-stability requirement and improves soundness of the negative analysis, but adds no successful held-out SDIL endpoint | | 2026-07-22 / `8d28fd9` stability S0 | A frozen training-only four-margin grid has no eligible candidate; sign-certified margins either overflow BN state or produce enormous transient loss and parameter growth | 5 → 5 | Closes fixed one-sided predictor bias and motivates a two-sided dynamic gain condition, but no validation endpoint or empirical support is gained | +| 2026-07-22 / `6b85249` dynamic projection D1 | The sole frozen training-prefix record passes 14/14 checks; a 0.0058 neutral residual is reduced to 3.0e-8 while weights, momentum, BN, and loss stay bounded | 5 → 5 | Establishes a nontrivial operator-stability repair, but training-only mechanics cannot change the recommendation | +| 2026-07-22 / `9bc58d6` dynamic projection D2 | The sole frozen short validation record reaches 83.58% versus clean KP's 82.66% and failed controls' 10%, with 0.884 early alignment, zero queries, and 1.326x BP MACs | 5 → 5 | First positive standard-ResNet load-bearing innovation endpoint, but one short seed is insufficient; full D3 and independent confirmation remain decisive | Future rows are appended only after an audited frozen stage. A score staying flat is informative: engineering, theory exposition, or visualization may make the paper more defensible without |
