diff options
| author | Yuren Hao <yurenh2@illinois.edu> | 2026-07-24 18:59:55 -0500 |
|---|---|---|
| committer | Yuren Hao <yurenh2@illinois.edu> | 2026-07-24 18:59:55 -0500 |
| commit | 86ef095e9619c3c6908cb2c95e1cd27532ff2904 (patch) | |
| tree | 44321bd3621f15f8df5addaa90404ad92994829d /ep_run/casc_eq_train.py | |
| parent | 27560970e2d967e62d22b8693811d7301fbc290d (diff) | |
RESULT 60b: res表在amp下宽度盲(bf16地板把fp32四个量级压成1.2×,棘轮首步死亡螺旋); 带内自适应在C768+amp判死,仪器=离线fp32探针; fw135m_b15(定点1.5e-3+bsign)+ckpt哨戒探针在飞; res/rho入wandb
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014FAPDWQ49M5Ye3NpTndTpn
Diffstat (limited to 'ep_run/casc_eq_train.py')
| -rw-r--r-- | ep_run/casc_eq_train.py | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/ep_run/casc_eq_train.py b/ep_run/casc_eq_train.py index 60b6113..0cd5521 100644 --- a/ep_run/casc_eq_train.py +++ b/ep_run/casc_eq_train.py @@ -908,6 +908,7 @@ for step in range(start_step, args.steps + 1): with torch.no_grad(): GOV['w_rms'] = float(sum(p.float().pow(2).mean().sqrt() for p in all_params) / len(all_params)) _aux = {'gn': GOV.get('gn'), 'drift': GOV.get('drift'), 'sig': GOV.get('sig'), + 'res': GOV.get('res'), 'rho': GOV.get('rho'), 'clip_norm': GOV.get('clip_norm'), 'clip_fired': (None if GOV.get('clip_norm') is None else float(GOV['clip_norm'] > 1.0))} for k in ('act_rms', 'w_rms', 'mag_ep', 'mag_bp'): if GOV.get(k) is not None: _aux[k] = GOV[k] |