Retire the correlation gate: the shared spectrum governs recovery

A controlled truncation refutes the project's central go/no-go rule.
Projecting the recovering synthetic fields to rank r holds the field
correlation at 0.902-0.929 while recovery moves 6.2% -> 12.9% -> 95.6%
across ranks 4, 8, 16. A field past the supposed 0.9 threshold recovers
13%, so correlation neither predicts nor forbids recovery and the width
of the shared spectrum is what moves it.

The gate becomes a joint condition on correlation and shared width,
measured by principal angles against a scene-shuffled null. Neither
suffices alone: 18 shared directions at 0.508 fails, 11 at 0.902 fails.

With the old gate retired, natural data was finally searched: 0.0000
against 0.0039 chance. The old verdict was right, its reasoning was not.

Also closes route D by measurement. rho_IT ~ sqrt(4 log N / N) rises as N
falls, and at N = 16 through 96 the deepest state a strong searcher
reaches is deeper than the truth in 3/3 replicates at every size.

Free gains: eigenvalue-weighted projection over a wide basis with
128-dim text vectors takes the correlation 0.656 -> 0.716 and shared
width 10 -> 16. Hubness refuted as an inflation hypothesis.

Moving the per-image segmentation eigendecomposition onto the GPU cut
batch time from 130s to 1.9s.

Co-Authored-By: Claude <noreply@anthropic.com>

1 files changed, 3 insertions, 0 deletions

diff --git a/logs/obj_base_gpu.log b/logs/obj_base_gpu.log
new file mode 100644
index 0000000..de196aa
--- /dev/null
+++ b/logs/obj_base_gpu.log
@@ -0,0 +1,3 @@
+Using a slow image processor as `use_fast` is unset and a slow processor was saved with this model. `use_fast=True` will be the default behavior in v4.52, even if the model was saved with a slow processor. This will result in minor differences in outputs. You'll still be able to use a slow processor with `use_fast=False`.
+`torch_dtype` is deprecated! Use `dtype` instead!
+
segment:   0%|          | 0/250 [00:00<?, ?it/s]
segment:   0%|          | 1/250 [00:02<10:41,  2.58s/it]
segment:   1%|          | 2/250 [00:04<08:49,  2.13s/it]
segment:   1%|          | 3/250 [00:06<08:11,  1.99s/it]
segment:   2%|▏         | 4/250 [00:08<07:52,  1.92s/it]
segment:   2%|▏         | 5/250 [00:09<07:41,  1.88s/it]
segment:   2%|▏         | 6/250 [00:11<07:02,  1.73s/it]
segment:   3%|▎         | 7/250 [00:12<06:28,  1.60s/it]
segment:   3%|▎         | 8/250 [00:13<06:06,  1.52s/it]
segment:   4%|▎         | 9/250 [00:15<05:50,  1.45s/it]
segment:   4%|▍         | 10/250 [00:16<05:40,  1.42s/it]
segment:   4%|▍         | 11/250 [00:17<05:31,  1.39s/it]
segment:   5%|▍         | 12/250 [00:19<05:26,  1.37s/it]
segment:   5%|▌         | 13/250 [00:20<05:23,  1.37s/it]
segment:   6%|▌         | 14/250 [00:21<05:20,  1.36s/it]
segment:   6%|▌         | 15/250 [00:23<05:16,  1.35s/it]
segment:   6%|▋         | 16/250 [00:24<05:14,  1.34s/it]
segment:   7%|▋         | 17/250 [00:25<05:12,  1.34s/it]
segment:   7%|▋         | 18/250 [00:27<05:10,  1.34s/it]
segment:   8%|▊         | 19/250 [00:28<05:07,  1.33s/it]
segment:   8%|▊         | 20/250 [00:29<05:06,  1.33s/it]
segment:   8%|▊         | 21/250 [00:31<05:04,  1.33s/it]
segment:   9%|▉         | 22/250 [00:32<05:01,  1.32s/it]
segment:   9%|▉         | 23/250 [00:33<04:59,  1.32s/it]
segment:  10%|▉         | 24/250 [00:35<04:58,  1.32s/it]
segment:  10%|█         | 25/250 [00:36<04:57,  1.32s/it]
segment:  10%|█         | 26/250 [00:37<04:56,  1.32s/it]
segment:  11%|█         | 27/250 [00:39<04:56,  1.33s/it]
segment:  11%|█         | 28/250 [00:40<04:55,  1.33s/it]
segment:  12%|█▏        | 29/250 [00:41<04:54,  1.33s/it]
segment:  12%|█▏        | 30/250 [00:43<04:53,  1.33s/it]
segment:  12%|█▏        | 31/250 [00:44<04:51,  1.33s/it]
segment:  13%|█▎        | 32/250 [00:45<04:48,  1.32s/it]
segment:  13%|█▎        | 33/250 [00:47<04:46,  1.32s/it]
segment:  14%|█▎        | 34/250 [00:48<04:44,  1.32s/it]
segment:  14%|█▍        | 35/250 [00:49<04:43,  1.32s/it]
segment:  14%|█▍        | 36/250 [00:51<04:43,  1.32s/it]
segment:  15%|█▍        | 37/250 [00:52<04:41,  1.32s/it]
segment:  15%|█▌        | 38/250 [00:53<04:40,  1.32s/it]
segment:  16%|█▌        | 39/250 [00:55<04:39,  1.32s/it]
segment:  16%|█▌        | 40/250 [00:56<04:36,  1.32s/it]
segment:  16%|█▋        | 41/250 [00:57<04:34,  1.31s/it]
segment:  17%|█▋        | 42/250 [00:59<04:33,  1.32s/it]
segment:  17%|█▋        | 43/250 [01:00<04:32,  1.32s/it]
segment:  18%|█▊        | 44/250 [01:01<04:31,  1.32s/it]
segment:  18%|█▊        | 45/250 [01:03<04:34,  1.34s/it]
segment:  18%|█▊        | 46/250 [01:04<04:31,  1.33s/it]
segment:  19%|█▉        | 47/250 [01:05<04:27,  1.32s/it]
segment:  19%|█▉        | 48/250 [01:06<04:25,  1.32s/it]
segment:  20%|█▉        | 49/250 [01:08<04:23,  1.31s/it]
segment:  20%|██        | 50/250 [01:09<04:21,  1.31s/it]
segment:  20%|██        | 51/250 [01:10<04:21,  1.31s/it]
segment:  21%|██        | 52/250 [01:12<04:20,  1.31s/it]
segment:  21%|██        | 53/250 [01:13<04:19,  1.32s/it]
segment:  22%|██▏       | 54/250 [01:14<04:17,  1.32s/it]
segment:  22%|██▏       | 55/250 [01:16<04:16,  1.32s/it]
segment:  22%|██▏       | 56/250 [01:17<04:15,  1.32s/it]
segment:  23%|██▎       | 57/250 [01:18<04:14,  1.32s/it]
segment:  23%|██▎       | 58/250 [01:20<04:13,  1.32s/it]
\ No newline at end of file