summaryrefslogtreecommitdiff
path: root/results/gelu_ablation/relu_dfa_s42.json
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-04-07 23:06:01 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-04-07 23:06:01 -0500
commite53327ac6d7d5be097c3de434caa700c52c598e9 (patch)
treeaa95e92f7859d426fcb290c57bb27ea57ab4213a /results/gelu_ablation/relu_dfa_s42.json
parent4172195ca318387e20e3576ab40187d4d2f08ebe (diff)
Add training-monitor early-stop demo: 96% compute savings on DFA
Demonstrates the practical use case of the protocol — not as a post-hoc audit but as an in-training abort condition. Walks through the existing per-epoch trace and shows when the protocol would have triggered an early stop on DFA training and what the saved compute would be. Result: DFA on 4-block d=256 ResMLP fires diagnostic (b) at epoch 4 with test acc 0.3076. The final acc at epoch 100 is *also* 0.3076 (identical). Stopping at epoch 4 saves 96% of compute with zero headline acc loss.
Diffstat (limited to 'results/gelu_ablation/relu_dfa_s42.json')
0 files changed, 0 insertions, 0 deletions