summaryrefslogtreecommitdiff
path: root/notes/02_experiment_notes.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-05-28 22:51:23 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-05-28 22:51:23 -0500
commit590baa92c66caeb939bae3fad0ed7cc9b2c87f75 (patch)
tree89edaca94b165879e1f322e244589593be99dc3c /notes/02_experiment_notes.md
parent7c2eaaa5ae6f9bc5b61de1f7f86b1cc0896b5596 (diff)
Add capacity scaling calculations
Diffstat (limited to 'notes/02_experiment_notes.md')
-rw-r--r--notes/02_experiment_notes.md24
1 files changed, 24 insertions, 0 deletions
diff --git a/notes/02_experiment_notes.md b/notes/02_experiment_notes.md
index b7f17a5..ab69cd8 100644
--- a/notes/02_experiment_notes.md
+++ b/notes/02_experiment_notes.md
@@ -235,3 +235,27 @@ Result:
- KS p-value: `0.633285`
This is a clean first-pass validation for the isotropic Gaussian case.
+
+## Scaling Run Log
+
+Script:
+
+```bash
+python scripts/capacity_scaling.py --plot
+```
+
+Default sweep:
+
+- widths: `16, 32, 64, 128`
+- feedback-aligned layer counts: `1, 2, 4, 8, 16`
+- fixed threshold: \(q=0.01\)
+- chance-level threshold: \(q=1/D\)
+- log unit: nats
+
+Result:
+
+- rows written: `40`
+- fixed-threshold max total cost: `1361.74` nats at width `128`, layers `16`
+- chance-level max total cost: `18.3652` nats at width `128`, layers `16`
+
+This cleanly separates the fixed-threshold regime, where total cost scales like \(Ln^2\), from the chance-level regime, where per-layer cost is nearly width-independent.