diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-05-28 22:51:23 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-05-28 22:51:23 -0500 |
| commit | 590baa92c66caeb939bae3fad0ed7cc9b2c87f75 (patch) | |
| tree | 89edaca94b165879e1f322e244589593be99dc3c /notes/02_experiment_notes.md | |
| parent | 7c2eaaa5ae6f9bc5b61de1f7f86b1cc0896b5596 (diff) | |
Add capacity scaling calculations
Diffstat (limited to 'notes/02_experiment_notes.md')
| -rw-r--r-- | notes/02_experiment_notes.md | 24 |
1 files changed, 24 insertions, 0 deletions
diff --git a/notes/02_experiment_notes.md b/notes/02_experiment_notes.md index b7f17a5..ab69cd8 100644 --- a/notes/02_experiment_notes.md +++ b/notes/02_experiment_notes.md @@ -235,3 +235,27 @@ Result: - KS p-value: `0.633285` This is a clean first-pass validation for the isotropic Gaussian case. + +## Scaling Run Log + +Script: + +```bash +python scripts/capacity_scaling.py --plot +``` + +Default sweep: + +- widths: `16, 32, 64, 128` +- feedback-aligned layer counts: `1, 2, 4, 8, 16` +- fixed threshold: \(q=0.01\) +- chance-level threshold: \(q=1/D\) +- log unit: nats + +Result: + +- rows written: `40` +- fixed-threshold max total cost: `1361.74` nats at width `128`, layers `16` +- chance-level max total cost: `18.3652` nats at width `128`, layers `16` + +This cleanly separates the fixed-threshold regime, where total cost scales like \(Ln^2\), from the chance-level regime, where per-layer cost is nearly width-independent. |
