diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-05-28 23:11:40 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-05-28 23:11:40 -0500 |
| commit | 0a3cc65f54d4ffc90b0e73f1f8713820352b27bf (patch) | |
| tree | 927f342b96e7ea71c444776d722c8c46e57de4ce /scripts/README.md | |
| parent | 89ebbd7ba50321e790520522939a941ff5ea96b7 (diff) | |
Add hidden gradient alignment metric
Diffstat (limited to 'scripts/README.md')
| -rw-r--r-- | scripts/README.md | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/scripts/README.md b/scripts/README.md index 42633d0..2d7a34c 100644 --- a/scripts/README.md +++ b/scripts/README.md @@ -125,6 +125,7 @@ a synthetic regression task. At each checkpoint, the script records: - training loss; - full-model cosine between the BP gradient and the FA surrogate gradient at the FA weights; +- hidden-layer-only cosine between the BP and FA gradients, excluding the output layer where gradients are identical; - layerwise \(Q_l=\cos^2(W_{l+1}^{\top},B_l)\). Outputs are written under `outputs/trajectory_mlp_fa/`: |