diff options
Diffstat (limited to 'BABYAI_SHARED_FEEDBACK.md')
| -rw-r--r-- | BABYAI_SHARED_FEEDBACK.md | 14 |
1 files changed, 13 insertions, 1 deletions
diff --git a/BABYAI_SHARED_FEEDBACK.md b/BABYAI_SHARED_FEEDBACK.md index addd58a..d00af72 100644 --- a/BABYAI_SHARED_FEEDBACK.md +++ b/BABYAI_SHARED_FEEDBACK.md @@ -88,7 +88,8 @@ candidate is eligible, B0 fails and the shared-path endpoint is not run. ## B1 mechanism endpoint The selected depth and learning rate are frozen. B1 trains for 40 epochs on -three model seeds with identical data and minibatch orders across conditions: +model and minibatch-order seeds `4101`, `4102`, and `4103`, with identical data +and minibatch orders across conditions: 1. `bp`: exact backpropagation reference with the same fixed mission pathway. 2. `clean_kp`: instruction-only reciprocal KP; this receives a separate clean @@ -114,3 +115,14 @@ Passing B1 opens `PickupLoc` and `PutNextLocalS6N4` with the same method and selection rule, followed by depth scaling. Failure is retained as evidence that task-required shared feedback alone is insufficient to make residualization useful in this setting. + +## B0 outcome + +All eight clean-selector runs were finite. BP and clean KP both reached +`97.8%` validation rollout success and `99.74%` expert-action accuracy in every +candidate. The two-layer, `0.01` learning-rate candidate was selected by the +frozen tie rule: its BP mission lesion reduced rollout success from `97.8%` to +`70.4%`, while it tied for the best clean-KP success and action accuracy and +used the fewest layers and smaller learning rate. The selector read no raw, +SDIL, or test result. This outcome opens B1 without establishing an SDIL +advantage. |