From 0a3cc65f54d4ffc90b0e73f1f8713820352b27bf Mon Sep 17 00:00:00 2001 From: YurenHao0426 Date: Thu, 28 May 2026 23:11:40 -0500 Subject: Add hidden gradient alignment metric --- scripts/README.md | 1 + 1 file changed, 1 insertion(+) (limited to 'scripts/README.md') diff --git a/scripts/README.md b/scripts/README.md index 42633d0..2d7a34c 100644 --- a/scripts/README.md +++ b/scripts/README.md @@ -125,6 +125,7 @@ a synthetic regression task. At each checkpoint, the script records: - training loss; - full-model cosine between the BP gradient and the FA surrogate gradient at the FA weights; +- hidden-layer-only cosine between the BP and FA gradients, excluding the output layer where gradients are identical; - layerwise \(Q_l=\cos^2(W_{l+1}^{\top},B_l)\). Outputs are written under `outputs/trajectory_mlp_fa/`: -- cgit v1.2.3