diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 13:10:14 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 13:10:14 -0500 |
| commit | 7ca9658999c8f882b3d5d295a4201cc9a1ce9cde (patch) | |
| tree | 2f289265d6b19ad22ee84da56525b2089e5499cb /README.md | |
| parent | 2ec92906b45018665de97d6de63d6a754a1508d6 (diff) | |
baseline: add convolutional hierarchical feedback alignment
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 6 |
1 files changed, 6 insertions, 0 deletions
@@ -115,6 +115,12 @@ path: it perturbs the channel-gated basis directly and reproduces the expected full-field delta rule with far less irrelevant spatial variance. It does not retroactively reopen or relabel the failed frozen Oral-A protocol. +The same smoke suite also audits a convolutional hierarchical-FA baseline. Its +random feedback tensors follow the real residual DAG and use local activation +Jacobians, but remain independent of forward weights. An audit-only symmetric +copy reproduces exact hidden gradients to `5.3e-16` relative error and the BP +parameter update to `2.98e-8`; actual HFA never performs that copy. + The subsequent V3 mechanism estimates the required A/G matrix statistics directly by perturbing the vectorizer parameter subspace. It remains forward-only and uses two causal loss queries per direction. Its exact and |
