diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 17:28:47 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 17:28:47 -0500 |
| commit | 24e299161c6040f64ace6181c1ee1c543851eff1 (patch) | |
| tree | eca323a185c20083648eb56bd5b86f7b5eaebbbc /RESULTS.md | |
| parent | d945c4213e57135c53bc18ed9811c7a61f1f761a (diff) | |
docs: record dynamic projection stability and short pass
Diffstat (limited to 'RESULTS.md')
| -rw-r--r-- | RESULTS.md | 34 |
1 files changed, 34 insertions, 0 deletions
@@ -961,6 +961,40 @@ freezes the predictor, restores loader state, and evaluates no validation or test example. Sign-only dissipativity is therefore closed before endpoint access; no margin is selected and the score remains 5/10. +The new dynamic neutral-projection branch does not weaken those negative stop +rules. Instead of another fixed margin, it uses a fast paired instruction-off +soma/apical observation to remove only the current affine component of the +*neutral* residual. The slow 64-example predictor remains frozen and the fast +fit sees zero task-instruction observations. The frozen D1 training-only gate +passes all 14 checks for 352 steps: maximum loss is `2.9281`, final-32 mean +loss is `1.6293`, maximum forward/feedback weights are `1.181/0.833`, and all +optimizer and BatchNorm states remain finite. The uncontrolled neutral +residual grows to `0.005833` of traffic RMS with a correction slope as large +as `0.02968`; projection holds the residual ratio and soma slope to +`3.03e-8` and `1.52e-8`. Thus the controller is active rather than benefiting +from an accidentally exact initialization. D1 evaluates neither validation +nor test and cannot change the paper score. + +The subsequently frozen D2 short validation endpoint also passes every gate: + +| method | validation accuracy | early alignment | epoch-11--20 feedback cosine | estimated MACs | +|:--|--:|--:|--:|--:| +| dynamic neutral-projection innovation | **83.58%** | 0.883830 | 0.860594 | 1.4519e14 | +| clean KP | 82.66% | 0.885583 | 0.854594 | 1.4519e14 | +| frozen MT-1 raw / matched | 10.00% / 10.00% | nonfinite | nonfinite | 1.4530e14 each | + +D2 is finite for all 20 epochs and ends with validation loss `0.511322` and +feedback/forward cosine `0.904056`. The unprojected neutral/traffic ratio +reaches `0.009561`, while the projected remainder stays below `3.04e-8` with +maximum soma slope `1.44e-8`; used-signal/instruction RMS differs by at most +`4.67e-10`. It uses zero task-loss queries, `1.3261x` BP MACs, 4.070e12 +separately reported elementwise operations, one paired neutral observation per +ordinary example, 2.165 GB peak allocated memory, one final validation +evaluation, and no test evaluation. This is the first stable load-bearing +innovation result on the standard ResNet substrate, but it is still a +one-seed short validation record. Per the frozen scoring rule it leaves the +reviewer score at 5/10 and opens only the predeclared D3 full validation run. + ## How to run `experiments/run.py --mode {bp,fa,dfa,sdil} --dataset {mnist,fmnist,cifar10} --depth D --residual {0,1} --act {tanh,gelu,silu,relu}` Batteries: `experiments/run_v2.sh <ds> "<depths>" <res> <act> "<seeds>" <ep> <pfx>`. |
