From bd6f3b8d3368c6459d07df383bb0f1df734d8df0 Mon Sep 17 00:00:00 2001 From: YurenHao0426 Date: Sat, 1 Aug 2026 23:48:26 -0500 Subject: Visual Genome is capped: part correspondence buys 0.023 Each VG region box is index-aligned with its own description, so the crop can be encoded and paired with the phrase describing it -- part correspondence by annotation, which is cross-modal supervision a deployed system would not have. The cross-modal anchor bound goes 0.336 -> 0.359. So the two encoders do not covary at the part level either, and no segmentation, aggregation, kernel or backbone repairs that. The 0.805 within-text ceiling was never the cross-modal ceiling; for this encoder pair on this corpus the cross-modal ceiling is about 0.36 against the 0.9 recovery needs. Six representational interventions this session were chosen without a ceiling in view -- the same error being made on the matching side at the same time. What replaces them is a three-number screening protocol that runs before any pipeline is built. Co-Authored-By: Claude --- logs/region_oracle.log | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100644 logs/region_oracle.log (limited to 'logs/region_oracle.log') diff --git a/logs/region_oracle.log b/logs/region_oracle.log new file mode 100644 index 0000000..bbfc070 --- /dev/null +++ b/logs/region_oracle.log @@ -0,0 +1,17 @@ +1156 scenes +Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`. +`torch_dtype` is deprecated! Use `dtype` instead! + crop: 0%| | 0/1156 [00:00