|
from-scratch ablation queue
- ep_step: floss block after resreg — unroll q=10 steps past z_T1 on a
sub-batch WITH graph, rho_hat = mean per-step delta growth, one-sided
relu(rho_hat - 0.995)^2, ramp keyed on (rho_hat - target) NOT resT1
(de-cliffed resreg: same fundamental path-LE quantity, linear early signal),
capped at floss fraction of task-grad norm (resreg convention).
- smoke: below-target = untouched (cos 1.0000); force-fire = finite grads,
capped perturbation (cos 0.9803).
- runs/abl3_queue.sh (runner live): waits for free GPU slots (0/1/3, GPU2
excluded), launches abl_floss (floss-only) / abl_resreg (resreg-only, never
cleanly run) / abl_pair (proven 2.09 recipe, control) with identical
remaining flags + seed.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
|
