summaryrefslogtreecommitdiff
path: root/scripts/README.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-05-29 08:43:19 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-05-29 08:43:19 -0500
commitdd14582dcfd3b6e3e7b0e28f66bb0f2994f106c4 (patch)
tree99c06ef0e6bb26a040409408040e1e88bc14f69f /scripts/README.md
parentc47a74792e6ee78181b087ead595465140b77825 (diff)
Add multilayer capacity distribution matching
Diffstat (limited to 'scripts/README.md')
-rw-r--r--scripts/README.md27
1 files changed, 27 insertions, 0 deletions
diff --git a/scripts/README.md b/scripts/README.md
index e30b309..efd4208 100644
--- a/scripts/README.md
+++ b/scripts/README.md
@@ -85,6 +85,33 @@ Outputs are written under `outputs/capacity_empirical_validation/`:
- `multilayer_capacity.csv`
- diagnostic plots when `--plot` is set.
+## Multilayer Observed Capacity Distribution
+
+Run:
+
+```bash
+python scripts/multilayer_capacity_distribution.py --dimensions 64 256 1024 4096 --layers 1 2 4 8 16 --samples 100000 --batch-size 8192 --seed 456 --plot
+```
+
+This validates the full null distribution of observed capacity surprisal:
+
+\[
+S_l=-\log P(Q_l'\ge Q_l).
+\]
+
+Theory predicts:
+
+\[
+S_l\sim \mathrm{Exp}(1),
+\qquad
+\sum_{l=1}^L S_l\sim \mathrm{Gamma}(L,1).
+\]
+
+The script samples random direction cosines through the exact chi-square
+representation \(Q=X/(X+Y)\), with \(X\sim\chi^2_1\) and
+\(Y\sim\chi^2_{D-1}\). Outputs are written under
+`outputs/multilayer_capacity_distribution/`.
+
## Minimax Initialization Bound
Run: