summaryrefslogtreecommitdiff
path: root/TRANSFORMER_CROSSOVER.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-07-27 14:33:27 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-07-27 14:33:27 -0500
commit438c30dc1b77f58c3c10f542bcf0e7bb724e2afd (patch)
tree26af11d760ee511d44e03ea50faca1221924c60e /TRANSFORMER_CROSSOVER.md
parent410857714740f9e2c4d8afd2c789bb63e85eb574 (diff)
experiment: enumerate Transformer crossover work
Diffstat (limited to 'TRANSFORMER_CROSSOVER.md')
-rw-r--r--TRANSFORMER_CROSSOVER.md8
1 files changed, 7 insertions, 1 deletions
diff --git a/TRANSFORMER_CROSSOVER.md b/TRANSFORMER_CROSSOVER.md
index 2bcff12..df0cf0f 100644
--- a/TRANSFORMER_CROSSOVER.md
+++ b/TRANSFORMER_CROSSOVER.md
@@ -186,7 +186,13 @@ allocated/reserved memory, forward/feedback parameters, ordinary training
and validation tokens, positive/negative or perturbed presentations,
candidate-token presentations, relaxation-token passes, local-VJP token
evaluations, first nonfinite step, and completed optimizer steps. The
-accuracy--cost plot and the within-family depth plot retain timeouts and
+hardware-independent ledger additionally enumerates full-forward token
+passes, extra local block/head evaluations, block affine MACs per token,
+causal-attention MACs per token, and whole-forward MACs per token. These
+primitive counts remain separate for DP/EP because a local VJP is not
+silently priced as an ordinary forward.
+
+The accuracy--cost plot and the within-family depth plot retain timeouts and
failures. A low-cost method is not declared scalable from depth 4 alone, and
an accurate DP/EP point is not declared local in the weight-transport-free
sense merely because its VJPs were evaluated at detached edges.