From ebc2e7f5129b81db745ad15e5b78b69a95b9837c Mon Sep 17 00:00:00 2001 From: Yuren Hao Date: Sat, 1 Aug 2026 14:11:25 -0500 Subject: Augmentation orbits do not substitute for multiple photographs Four random resized crops per Visual Genome image, segmented independently with their fields averaged, leave the correlation at 0.6559. Closed-world re-renders resample layout, which is nuisance by construction, so averaging removes modality-private variation; random crops perturb framing that self-supervised patch features already absorb, leaving nothing to cancel. Co-Authored-By: Claude --- LAB_NOTES.md | 14 ++++++++++---- 1 file changed, 10 insertions(+), 4 deletions(-) (limited to 'LAB_NOTES.md') diff --git a/LAB_NOTES.md b/LAB_NOTES.md index d8d235f..8c0e9d5 100644 --- a/LAB_NOTES.md +++ b/LAB_NOTES.md @@ -549,10 +549,16 @@ statistics (0.19 for DINOv2 crop CLS against Qwen phrase states), so in-context features and corpus-specific distributional vectors are the better substrate. -Verdict: 0.656 against the 0.9 recovery needs; no recovery run. The -untried lever is observation orbits, which VG lacks by construction -- -one photograph per scene. Multi-view natural data is the next protocol -requirement. +Augmentation orbits were then tried and give nothing: four random resized +crops per image, segmented independently with fields averaged, move the +correlation from 0.6559 to 0.6559. Re-renders in the closed world +resample layout, which is nuisance by construction; random crops perturb +framing, which self-supervised patch features already absorb, so the +average has nothing to cancel. Multi-view observation means separate +photographs, not transformations of one. + +Verdict: 0.656 against the 0.9 recovery needs; no recovery run, and the +orbit lever is unavailable on this corpus. See `NATURAL_RESULTS.md`. -- cgit v1.2.3