diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-03-27 14:25:00 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-03-27 14:25:00 -0500 |
| commit | 65d97ad1ef4b552103420e6501655df192c98d57 (patch) | |
| tree | b3638d4fd4c8eb0f61e57d44dd41d553d33e6d85 /experiments/bp_support_sparsity.py | |
| parent | b4e3cbeae6cb4cf4a4b69b84a475afcd7d7e9dbe (diff) | |
Add Phase 10A.7: minimal aux compression — continuous trainability is essential
8-branch dissection:
- zero_target + normmatched both crash: non-zero direction necessary, not norm
- perlayer_vector: +0.7% (per-block trainable vector works, network not required)
- freeze_after_{1,5,10}: ALL crash to ~13-14% (continuous trainability essential)
- random_trainable: +1.0% (reference)
Minimal mechanism: continuously trainable, non-zero, depth-aware auxiliary perturbation.
Freezing at ANY point destroys the benefit entirely.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'experiments/bp_support_sparsity.py')
0 files changed, 0 insertions, 0 deletions