summaryrefslogtreecommitdiff
path: root/experiments/gelu_ablation.py
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-04-08 17:33:26 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-04-08 17:33:26 -0500
commit673d78d03f5447fa010083512d20072beacd302b (patch)
tree02f9869109daa93edb4afe47d6252f60be54d8ce /experiments/gelu_ablation.py
parent61d483e429f4fead0e44805eba0f643b7464c6e9 (diff)
paper v2.30.1: ground-truth ||g_2|| values in §4 ¶1
Fresh re-measurement on the saved early checkpoints (per_layer_cos_3seed.json) gives ||g_2|| at ep 1: s42: 6.79e-7 → paper rounds 6.8e-7 s123: 6.57e-7 → paper rounds 6.6e-7 s456: 3.85e-7 → paper rounds 3.8e-7 The previous prose values (6.7, 6.5, 3.9) were carried over from ad-hoc measurements with inconsistent rounding (3.9 was an error; 3.85 rounds to 3.8). All three values are still well above the 1e-7 diagnostic-(b) threshold, so the §4 ¶1 mode-2-without-mode-1 claim is unchanged. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'experiments/gelu_ablation.py')
0 files changed, 0 insertions, 0 deletions