diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 16:38:42 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 16:38:42 -0500 |
| commit | 575530e7124c540e58571b50ef147a5f20e6cb54 (patch) | |
| tree | c1058abde90f59d2e9b594661f1794b6e974ae18 /RESULTS.md | |
| parent | d818fc26cdcbc00521e4cd4e347e74d5cd3e5670 (diff) | |
docs: explain mixed-traffic instability
Diffstat (limited to 'RESULTS.md')
| -rw-r--r-- | RESULTS.md | 12 |
1 files changed, 12 insertions, 0 deletions
@@ -937,6 +937,18 @@ alignment, feedback-tracking, and usable matched-norm checks fail. MT-2 and the five-seed test confirmation remain untouched. This closes the controlled standard-ResNet accept recovery and leaves the reviewer estimate at 5/10. +The clean training-only failure-localization records at revision `e996231` +evaluate neither validation nor test data. They identify the first +training-active nonfinite tensors as stem `W[0]` and its momentum at step 23 +for raw, step 69 for norm-matched raw, and step 74 for innovation. Predictor +slopes, feedback weights, and feedback momenta remain finite when each +diagnostic stops. At innovation step 1, loss is +2.91 and used-signal RMS is 0.00477; by step 16 they reach `4.14e5` and 1.76. +Thus norm matching and subtraction substantially delay, but do not stabilize, +the forward local feedback mode. The linearized update in `THEORY.md` exposes +the multiplicative term `D W C` and proves that any positive effective scalar +mode has momentum transition spectral radius above one. + ## How to run `experiments/run.py --mode {bp,fa,dfa,sdil} --dataset {mnist,fmnist,cifar10} --depth D --residual {0,1} --act {tanh,gelu,silu,relu}` Batteries: `experiments/run_v2.sh <ds> "<depths>" <res> <act> "<seeds>" <ep> <pfx>`. |
