diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 13:35:13 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-07-22 13:35:13 -0500 |
| commit | 37cf78b7f696c9eedc0745ebdaa656bff0ab2f81 (patch) | |
| tree | 37bef77b388614e404703dba305f232bed5423bb /MIRROR_BASELINE.md | |
| parent | 0db651ac83608ea8f5b94950a391da22f076a142 (diff) | |
protocol: freeze normalized mirror baseline funnel
Diffstat (limited to 'MIRROR_BASELINE.md')
| -rw-r--r-- | MIRROR_BASELINE.md | 86 |
1 files changed, 86 insertions, 0 deletions
diff --git a/MIRROR_BASELINE.md b/MIRROR_BASELINE.md new file mode 100644 index 0000000..c7ad348 --- /dev/null +++ b/MIRROR_BASELINE.md @@ -0,0 +1,86 @@ +# Normalized response-mirror baseline protocol + +## Status and attribution + +This protocol was frozen before observing any CIFAR-prefix response-mirror +alignment or accuracy endpoint. A mechanics-only pilot on synthetic Gaussian +images was used to choose the bounded mirror-rate grid; it did not load the +frozen CIFAR development split or evaluate validation/test accuracy. + +The method is an inherited strong baseline, not SDIL novelty. It is a +normalized, bias-blocked local system-identification variant of Akrout et al.'s +[weight mirror](https://proceedings.neurips.cc/paper_files/paper/2019/file/f387624df552cea2f369918c5e1e12bc-Paper.pdf). +Gaussian parent probes pass through ordinary local forward synapses and a +separate update receives only the probe and child preactivation response. The +local correlation estimates the forward kernel; Q/R track that estimate by an +exponential delta rule. The task-error path remains the audited hierarchical +FA residual DAG. + +Any BP-like scale obtained here belongs to weight estimation. It can raise the +bar SDIL must beat but cannot raise SDIL novelty or rescue failed Oral-A-v1. +Only a later, separately frozen demonstration that somato-dendritic innovation +is load-bearing on top of this path can improve the paper-level claim. + +## WM-0: mechanics gate + +Before endpoints, the smoke suite must show: + +- one 16-probe local observation has mean feedback/forward cosine above 0.985 + and minimum cosine above 0.95 on a deterministic tiny ResNet; +- every feedback/forward norm ratio is in `[0.90, 1.10]`; +- after observations are fixed, changing all forward parameters changes the + feedback update by exactly zero; +- all hierarchical-gradient and convolutional local-update audits remain + green. + +The gate passed at mean/min cosine `0.988701/0.966066`, norm ratios +`[0.953729,1.044368]`, and update independence error exactly zero. + +## WM-1: frozen-forward CIFAR causal-capture gate + +Use seed-0 ResNet-20, random feedback scale 1, the first 10,000 examples of the +frozen development split, batch 128 for the diagnostic graph, and the fixed +64-example training-prefix exact-gradient audit. Forward weights, readout, +BatchNorm state, and affine parameters remain bitwise fixed. + +Record one fixed-HFA reference. For each `eta_M in {0.03, 0.1, 0.3}`, run 20 +local mirror observations with convolutional probe batch 1, Gaussian noise +standard deviation 1, and mirror seed 3000. No task loss or label is consumed +by mirroring; the final alignment audit alone uses labels. Select maximum +early-third alignment, then all-layer alignment, then lower rate. + +WM-1 passes only if all four records are finite and selected WM: + +1. reaches early-third teaching alignment at least `0.40`; +2. reaches all-layer alignment at least `0.50`; +3. reaches mean feedback/forward cosine at least `0.85`; +4. keeps every feedback/forward norm ratio in `[0.5, 1.5]`; +5. records zero logical task-loss queries during mirror learning. + +No mirror batch, step count, noise scale, rate, covariance estimator, or +per-layer schedule is added after observation. + +## WM-2: bounded short accuracy gate + +Only a WM-1 pass opens a matched 10k-example, 20-epoch ResNet-20 validation +screen. Copy A2b data, augmentation, batch 128, cosine schedule, no warmup, +momentum 0.9, weight decay `1e-4`, and output LR 0.1. Cross hidden LR +`{0.03,0.1}`. Use the selected mirror rate, 20 mirror warmup observations, +then one batch-1 mirror observation every 16 task updates. Select validation +accuracy, then lower total MACs/rate. + +Advance only if both runs are finite, selected WM reaches at least 65%, stays +within 10 points of BP's matched 74.94%, retains early alignment at least 0.30, +uses zero task-loss queries for feedback learning, and costs no more than 1.15x +matched BP estimated MACs. Failure closes the baseline without tuning. + +## WM-3: full validation baseline + +Only a WM-2 pass opens one 200-epoch seed-0 validation run on all 45,000 +development-training examples. Copy its selected hidden rate, mirror settings, +output LR 0.1, and the A1 step drops at epochs 100/150. No recovery branch is +allowed. A finite endpoint at least 88% with early alignment at least 0.30 and +cost at most 1.15x BP is considered a strong inherited baseline. It does not +authorize test access; it instead opens design of a hierarchical innovation +intervention on the same frozen recipe. + |
