diff options
| author | Yuren Hao <blackhao0426@gmail.com> | 2026-08-01 14:11:25 -0500 |
|---|---|---|
| committer | Yuren Hao <blackhao0426@gmail.com> | 2026-08-01 14:11:25 -0500 |
| commit | ebc2e7f5129b81db745ad15e5b78b69a95b9837c (patch) | |
| tree | 07ae6afc906f0c7090d659476504f93454166357 /LAB_NOTES.md | |
| parent | a62cf4d2a99b4a7985c61b2a7feb92a82a8218b7 (diff) | |
Augmentation orbits do not substitute for multiple photographs
Four random resized crops per Visual Genome image, segmented
independently with their fields averaged, leave the correlation at
0.6559. Closed-world re-renders resample layout, which is nuisance by
construction, so averaging removes modality-private variation; random
crops perturb framing that self-supervised patch features already
absorb, leaving nothing to cancel.
Co-Authored-By: Claude <noreply@anthropic.com>
Diffstat (limited to 'LAB_NOTES.md')
| -rw-r--r-- | LAB_NOTES.md | 14 |
1 files changed, 10 insertions, 4 deletions
diff --git a/LAB_NOTES.md b/LAB_NOTES.md index d8d235f..8c0e9d5 100644 --- a/LAB_NOTES.md +++ b/LAB_NOTES.md @@ -549,10 +549,16 @@ statistics (0.19 for DINOv2 crop CLS against Qwen phrase states), so in-context features and corpus-specific distributional vectors are the better substrate. -Verdict: 0.656 against the 0.9 recovery needs; no recovery run. The -untried lever is observation orbits, which VG lacks by construction -- -one photograph per scene. Multi-view natural data is the next protocol -requirement. +Augmentation orbits were then tried and give nothing: four random resized +crops per image, segmented independently with fields averaged, move the +correlation from 0.6559 to 0.6559. Re-renders in the closed world +resample layout, which is nuisance by construction; random crops perturb +framing, which self-supervised patch features already absorb, so the +average has nothing to cancel. Multi-view observation means separate +photographs, not transformations of one. + +Verdict: 0.656 against the 0.9 recovery needs; no recovery run, and the +orbit lever is unavailable on this corpus. See `NATURAL_RESULTS.md`. |
