summaryrefslogtreecommitdiff
path: root/BABYAI_SHARED_FEEDBACK.md
diff options
context:
space:
mode:
authorYurenHao0426 <Blackhao0426@gmail.com>2026-08-10 10:18:26 -0500
committerYurenHao0426 <Blackhao0426@gmail.com>2026-08-10 10:18:26 -0500
commite3011f144a018f6415b3c2a636c0646e412b3ced (patch)
tree3f1920a2e7b2cb9208aeb92676a7f2929f1f3c25 /BABYAI_SHARED_FEEDBACK.md
parent20fd3577693593e3f62bcc4e1c2565dca5349944 (diff)
results: select BabyAI clean configuration
Diffstat (limited to 'BABYAI_SHARED_FEEDBACK.md')
-rw-r--r--BABYAI_SHARED_FEEDBACK.md14
1 files changed, 13 insertions, 1 deletions
diff --git a/BABYAI_SHARED_FEEDBACK.md b/BABYAI_SHARED_FEEDBACK.md
index addd58a..d00af72 100644
--- a/BABYAI_SHARED_FEEDBACK.md
+++ b/BABYAI_SHARED_FEEDBACK.md
@@ -88,7 +88,8 @@ candidate is eligible, B0 fails and the shared-path endpoint is not run.
## B1 mechanism endpoint
The selected depth and learning rate are frozen. B1 trains for 40 epochs on
-three model seeds with identical data and minibatch orders across conditions:
+model and minibatch-order seeds `4101`, `4102`, and `4103`, with identical data
+and minibatch orders across conditions:
1. `bp`: exact backpropagation reference with the same fixed mission pathway.
2. `clean_kp`: instruction-only reciprocal KP; this receives a separate clean
@@ -114,3 +115,14 @@ Passing B1 opens `PickupLoc` and `PutNextLocalS6N4` with the same method and
selection rule, followed by depth scaling. Failure is retained as evidence
that task-required shared feedback alone is insufficient to make
residualization useful in this setting.
+
+## B0 outcome
+
+All eight clean-selector runs were finite. BP and clean KP both reached
+`97.8%` validation rollout success and `99.74%` expert-action accuracy in every
+candidate. The two-layer, `0.01` learning-rate candidate was selected by the
+frozen tie rule: its BP mission lesion reduced rollout success from `97.8%` to
+`70.4%`, while it tied for the best clean-KP success and action accuracy and
+used the fewest layers and smaller learning rate. The selector read no raw,
+SDIL, or test result. This outcome opens B1 without establishing an SDIL
+advantage.