diff options
Diffstat (limited to 'BABYAI_SHARED_FEEDBACK.md')
| -rw-r--r-- | BABYAI_SHARED_FEEDBACK.md | 23 |
1 files changed, 23 insertions, 0 deletions
diff --git a/BABYAI_SHARED_FEEDBACK.md b/BABYAI_SHARED_FEEDBACK.md index 74188ea..e214ead 100644 --- a/BABYAI_SHARED_FEEDBACK.md +++ b/BABYAI_SHARED_FEEDBACK.md @@ -145,3 +145,26 @@ across seeds and the task does not satisfy the central endogenous-context premise. B1 fails as paper evidence and is retained without a norm-matched follow-up. The next BabyAI task is `PickupLoc`, which contains eight candidate objects per audited episode. + +## P0 PickupLoc clean feasibility + +`BabyAI-PickupLoc-v0` replaces the diagnostic task. A direct structure audit +found eight ball, box, or key objects in every one of 100 generated episodes; +the mission selects which object to pick up. The standard partial `7 x 7` +symbolic observation is retained. Because the present policy is feedforward, +P0 first asks whether this architecture can solve the task before any raw or +SDIL condition is exposed. + +P0 generates 20,000 training demonstrations, 2,000 validation demonstrations, +and 500 disjoint validation rollout seeds from the official `BabyAIBot`. It +uses the same clean-only grid as B0: hidden depth `2` or `4`, width `256`, +learning rate `0.01` or `0.03`, context gain `1.0`, 15 epochs, and seed `4101`. +A candidate is eligible if BP rollout success is at least `70%`, clean-KP +success is at least `60%`, and removing the mission field reduces BP success by +at least 20 points. Selection maximizes clean-KP rollout success, then action +accuracy, then chooses fewer layers and the smaller learning rate. + +If no candidate is eligible, raw and SDIL are not run on this architecture; +the next method change must supply task memory rather than tune shared-feedback +strength. If P0 passes, the chosen configuration enters the same 40-epoch, +three-seed BP/clean-KP/raw/SDIL comparison as B1. |