diff options
Diffstat (limited to 'RANK_RESULTS.md')
| -rw-r--r-- | RANK_RESULTS.md | 31 |
1 files changed, 31 insertions, 0 deletions
diff --git a/RANK_RESULTS.md b/RANK_RESULTS.md index 0e481b9..2998e47 100644 --- a/RANK_RESULTS.md +++ b/RANK_RESULTS.md @@ -118,6 +118,37 @@ directions and then stops. Enlarging the scene population does not help either scenes, so the ceiling is a property of what the two corpora are about rather than of how many scenes are sampled. +## Corpus overlap sets the width, by intervention + +The invariance results say the width does not come from the encoders. A +controlled intervention says where it does come from. In the synthetic world +the caption is encoded into separate factor blocks, so a block can be +suppressed — the caption then never states that property while vision +continues to see it. Nothing else changes: same images, same segmentation, +same kernel. + +| Caption content | ρ | shared | recovery | +|---|---|---|---| +| states everything | 0.928 | 20 | **96.4%** | +| never states size | 0.830 | 15 | **5.6%** | + +Deleting one word class costs five shared directions and the entire result. +The correlation is still 0.830 — higher than anything we have achieved on +photographs — and recovery is at chance. **The synthetic world degraded to +Visual Genome's shared width fails exactly the way Visual Genome fails**, at a +correlation Visual Genome never reaches. + +This closes the causal chain. How much of the same world the two corpora +describe sets the width of the shared spectrum; the width sets recovery; and +the correlation reports on neither reliably. It also reframes the natural-data +deficit as a statement about Visual Genome rather than about our pipeline: a +region description simply does not say as much about a photograph as the +synthetic captions say about their scenes. + +(Widths in this table are computed on standardised fields and are not +comparable entry-for-entry with the tables above, which use raw fields; within +the table the convention is identical, which is what the comparison needs.) + ## Two smaller results, one refuted hypothesis **The projection improved.** Scaling each discriminant direction by its own |
