1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
|
# ICLR 2027 paper plan
This document maps the frozen evidence to a defensible paper narrative. It is
not permission to promote development results or to hide failed gates.
## One-sentence claim
Per-neuron subtraction of the apical component predictable from neutral
somatic activity isolates an innovation signal that can preserve useful local
credit when raw feedback is contaminated by ordinary soma-coupled traffic;
when paired with causally learned feedback, the resulting local learner
preserves accuracy and alignment over depth substantially better than fixed
direct feedback in the audited regime.
This sentence deliberately says neither that cortex implements
backpropagation nor that the current model explains Harnett's temporal-error
signature. “Scales on standard residual networks” may be added only after the
untouched Oral-A confirmation passes.
## Working title
**Learning from the Unexpected: Somato-Dendritic Innovations for Local Credit
Assignment**
If Oral-A A4 passes cleanly, “Scalable” may be added to the title. If A3 or A4
fails, the title stays mechanism-focused and the standard-scale result appears
as a limitation rather than a title claim.
## Abstract logic
1. Biological and local-learning models often treat raw apical activity as a
teaching signal even though it also carries ordinary state/context traffic.
2. Inspired by the per-neuron residual measured by Harnett and colleagues,
define teaching as apical activity minus its neutral-period prediction from
the same neuron's soma.
3. Show that this is the orthogonal conditional innovation within the chosen
somatic function class; norm matching cannot reproduce its directional
effect. Calibrate the inherited feedback map using causal perturbations and
update forward weights with local eligibilities.
4. Report the frozen residual-necessity panel: at strong predictable traffic,
innovation retains `97.35%` while raw and norm-matched raw reach about
chance, with an `87.038 +/- 0.607`-point paired gain over norm-matched raw.
5. Report the frozen depth panel: SDIL changes by only
`-0.214 +/- 0.349` points over 12x hidden depth while DFA alignment falls to
`0.047`; qualify that flattened CIFAR is depth-flat.
6. Report native BurstCCN and Dual Prop as method-native context, including
their unmatched protocols and audited walls. Report the failed
standard-ResNet A3 gate as a limitation: short-run SDIL beat tuned DFA, but
the full recipe became nonfinite and did not open A4. The later dynamic
neutral-projection D2 result may be mentioned as a short seed-0 recovery
(`83.58%`) but cannot support a full-scale abstract claim unless D3 and its
independent confirmation pass. End with the supported scope: innovation is
useful for soma-predictable traffic, while learned feedback amortization and
independently confirmed long-horizon stability remain bottlenecks.
The abstract should not mention the failed desired-velocity hypothesis unless
the paper explicitly positions that falsification as a contribution. It must
not imply that no-traffic scaling establishes the necessity of residualization.
## Contribution statements
1. **Mechanism.** A per-cell neutral-period innovation rule for separating
task instruction from ordinary apical traffic, with raw and norm-matched
controls.
2. **Theory.** A conditional-projection account of what residualization can
optimally remove, its failure boundary, a descent condition separating
direction/gain/curvature, and exact simultaneous-perturbation variance.
The conditional-expectation theorem itself is standard and is not claimed
as mathematical novelty.
3. **Evidence.** Frozen, seed-complete tests of innovation necessity, depth
preservation, alignment, query/MAC/memory cost, and direct-versus-amortized
causal feedback.
4. **Scientific negatives.** Broad top-down traffic, useful-depth learned
vectorization, the Harnett desired-velocity signature, and full standard
ResNet stability fail their frozen gates, defining the method's actual
boundary.
5. **Standard scale.** Do not claim it yet: A3 failed and the dynamic
projection branch currently has only one short validation endpoint. A
predeclared full D3 result plus the already frozen paired five-seed D4
confirmation is required.
## Figure order in the manuscript
The current filenames reflect generation history rather than final paper
numbering.
1. **Mechanism and necessity:** current `figure3_innovation`. Lead with the
subtraction diagram, accuracy under traffic, and used-signal alignment.
2. **Accuracy/cost:** current `figure1_pareto`, augmented by the completed
native-author table in the text or supplement. Do not place unmatched
architectures on one purported equal-compute frontier.
3. **Depth scaling:** current `figure2_scaling`. Retain the MLP result as a
controlled depth-preservation diagnosis; report the failed ResNet-20 A3
trajectory in the limitations or supplement, not as a scaling figure.
4. **Mechanism/cost anatomy:** query-budget retention, direct-NP diagnosis,
predictor timescale, and failure boundaries. The audited
`figureS_dynamic_stability` gives the clearest current sequence—fixed
predictor explosion, continually removed neutral coupling, and restored
short-run learning—and should move into the main paper if D3 passes.
5. **Biological signatures:** the complete failed Oral-B screen belongs in the
supplement/limitations unless the paper foregrounds falsification. Report
its positive decodability and negative causal-role results together.
## Section skeleton
### 1. Introduction
- Mixed apical traffic is the unaddressed problem, not merely transporting an
output error to a dendrite.
- Harnett motivates a per-neuron residual operation without proving that it is
a plasticity signal.
- Existing dendritic, feedback-alignment, Dual Prop, BurstCCN, and learned
synthetic-feedback methods define the prior-art boundary.
### 2. Somato-dendritic innovation learning
- Forward dynamics and local eligibility.
- Neutral predictor and innovation.
- Causal perturbation calibration, clearly attributed to learned synthetic
feedback prior art.
- Online-control variant described only as a tested hypothesis, not as the
successful method.
### 3. Theory and resource accounting
- Conditional projection and task-period absorption.
- Multiplicative residual coupling, the two-sided momentum/Jury stability
window, and fast neutral projection as a local empirical certificate.
- Hidden alignment versus parameter descent.
- Simultaneous perturbation bias/variance.
- Logical loss queries, MACs, memory, and wall time as separate axes.
### 4. Does innovation matter?
- Frozen 60-run predictable-traffic panel and matched-raw control.
- Endogenous C1 near-miss/failure and FashionMNIST recovery failure.
- The allowed claim is restricted to the predictor's somatic information.
### 5. Does causal local credit survive depth?
- Five-depth BP/FA/DFA/SDIL panel and local Pareto frontier.
- Direct-NP useful-depth diagnosis and the failed learned-vectorizer branches.
- Low-query confirmation.
- Standard ResNet results only according to the frozen A1--A4 branch.
### 6. Relation to biological signatures
- Residual decorrelation, decoder, and plasticity-lesion positives.
- Wrong sign-inversion, error-magnitude dominance, and weak acute online
lesion; desired velocity is unsupported.
### 7. Limitations and discussion
- Predictor observability and distribution invariance.
- Perturbation variance and feedback amortization.
- Standard architecture/energy cost versus biological plausibility.
- No inference from algorithmic utility to the causal role of dendritic
residuals in cortex.
## Reviewer objection map
| Objection | Evidence that addresses it | Residual risk |
|:--|:--|:--|
| “This is Lansdell synthetic feedback renamed.” | `NOVELTY.md`; no-traffic method explicitly attributed; raw/matched/innovation panel isolates the new operation | Novelty remains narrow and needs clear writing |
| “The residual only clips an oversized signal.” | Per-example norm-matched raw control; positive scaling preserves cosine; Figure mechanism panel | Artificial predictable traffic is still a controlled construction |
| “Depth does not help this task.” | Claim says preservation; C2 reports the learned-vectorizer failure; Oral-A A3 is retained as a failed standard-scale test | Fatal to a broad scaling claim; the paper must remain mechanism-focused |
| “Local methods hide enormous extra work.” | Logical queries, MACs, peak memory, wall time, C3 confirmation, EP/native protocols | Hardware implementations are not all equally optimized |
| “Weak baselines define the win.” | BP/FA/DFA/direct NP/FF/PEPITA/EP plus native BurstCCN and Dual Prop | Native reproductions are one seed and method-native, not equal compute |
| “Harnett already proves the biological story.” | Oral-B preregistration and complete negative result | Biological contribution is limited without new data or a new passed prediction |
| “The fast controller is just an unreported contrastive phase.” | Paired neutral observation count and elementwise/wall cost are explicit; no task-nudged state, loss query, or reverse pass is used | The instruction-off microphase is a real assumption and weakens the single-phase biological claim |
| “The gates were selected after results.” | Git-frozen protocols, untouched confirmation seeds, failed branches retained | Early inherited pilots predate the strict boundary and must remain labeled |
## Result-dependent branch
### If A3/A4 pass
Lead with the standard ResNet result, promote empirical support, and retain the
MLP useful-depth failure as a diagnosis of the earlier vectorizer. The paper
can plausibly claim a rare local-learning method that retains performance and
alignment with standard depth under an audited cost budget. Reviewer score
should be reassessed from the frozen confirmation only.
### If A3 or A4 fails
Do not soften the threshold or replace the seed panel. Keep a mechanism paper:
innovation is load-bearing under identifiable mixed traffic and the inherited
causal-feedback backbone preserves depth on the controlled task, but standard
useful scaling remains unresolved. The correct response is a narrower title,
claim, and score—not another post-hoc ResNet tuning branch.
This is the realized branch: A3 SDIL became nonfinite at epoch 89 and ended at
chance. A4 remained untouched. The working title therefore stays
mechanism-focused, and the standard-ResNet result is a disclosed limitation.
## Post-A3 accept recovery: innovation on a strong inherited substrate
The failed direct-vectorizer A3 branch remains closed. The post-failure
baseline audit found two sharply different outcomes: intermittent residual
response mirroring ends at chance with NaN validation loss despite 0.999998
endpoint Q/W cosine, while modified Kolen--Pollack passes its frozen 20-epoch
screen at 82.66%. Both mechanisms are inherited and receive no novelty credit.
`MIXED_TRAFFIC.md` defines the only current route that can revise the
standard-ResNet conclusion. It keeps reciprocal KP fixed as the instructional
substrate and crosses raw, norm-matched raw, and neutral-period innovation
under identical four-times-RMS soma-predictable traffic. One short screen, one
full seed-0 validation panel, and one untouched five-seed test panel were
frozen before any mixed-traffic task endpoint. Only the complete final panel
can raise the reviewer estimate to 6/10.
If it passes, revise the abstract and contribution language narrowly:
- claim that somato-dendritic innovation is load-bearing on a standard
ResNet-20 with a strong zero-query local reciprocal credit path;
- attribute credit transport and reciprocal plasticity explicitly to Akrout
et al.; do not describe KP performance as SDIL novelty;
- report the 376,832 predictor parameters, elementwise arithmetic, affine
MACs, peak memory, and wall time rather than presenting a MAC-only frontier;
- retain failed natural/top-down traffic and desired-velocity results, so the
claim remains predictable-traffic removal rather than a cortical model.
If MT-1, MT-2, or MT-3 fails, preserve the current mechanism-only narrative and
the score of 5/10. No lower traffic ratio, deleted seed, or replacement
confirmation panel is permitted.
This stop rule has now fired at MT-1. All three signal conditions become
nonfinite in epoch 1 and end at chance despite passing the calibration,
predictor-warmup, query, and cost invariants. MT-2 and MT-3 remain untouched.
The paper therefore retains the mechanism-focused title and 5/10 assessment;
the controlled standard-ResNet recovery is a disclosed negative result, not an
active acceptance claim.
## Post-MT-1 operator-stability branch
MT-1 remains failed and its sealed MT-2/MT-3 panels are never reopened. The
separate post-failure theory identifies the predictor error as the
multiplicative operator `D W C`; S0 then falsifies fixed sign-only margins.
`DYNAMIC_INNOVATION.md` defines a new evaluation boundary: a slow neutral
predictor plus a fast paired instruction-off projection of the remaining
neutral residual. This is closer to a local apical shunting/homeostatic
controller than to Dual Prop's two oppositely nudged task states, but the paper
must disclose the extra microphase rather than call the method single-phase.
D1 passes its training-only stability gate. D2 then reaches `83.58%` at 20
epochs versus clean KP's `82.66%`, while the failed raw/matched controls remain
at `10%`; all projection, query, MAC, memory, and evaluation-boundary checks
pass. This is the first standard-ResNet evidence for load-bearing innovation,
but it is one short validation run and therefore leaves the score at 5/10.
The predeclared D3 run is the next paper-changing gate. Only a complete
near-BP 200-epoch pass can move the simulated reviewer score to 6 and authorize
an independently frozen multi-seed test confirmation. If D3 fails, preserve
the dynamic short result as a stability diagnosis and do not replace the
schedule, thresholds, or traffic intervention.
|