<feed xmlns='http://www.w3.org/2005/Atom'>
<title>World-Alignment.git/worldalign/encoder_matrix.py, branch main</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/World-Alignment.git/'/>
<entry>
<title>Off-the-shelf encoder scale is flat: 22M to 1.5B moves the bound 0.328 to 0.311</title>
<updated>2026-08-02T04:59:53+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-08-02T04:59:53+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/World-Alignment.git/commit/?id=7dbbf2d467e25112534c0caf163b2222dfd9fb7e'/>
<id>7dbbf2d467e25112534c0caf163b2222dfd9fb7e</id>
<content type='text'>
Seven text encoders against a fixed DINOv2 vision side, priced by the
anchor bound rather than the retired field correlation:

  PPMI          0.289    BGE-large 335M   0.308
  MiniLM 22M    0.328    Qwen 0.5B        0.325
  mpnet 110M    0.341    Qwen 1.5B        0.311
  bert 110M     0.341    part-oracle ceiling 0.359

No correlation with scale and the largest model is not the best; a
retrieval-tuned 335M encoder is worse than bert-base. All seven sit in a
0.29-0.34 band against a part-oracle ceiling of 0.359, so swapping in a
stronger off-the-shelf encoder is closed as a route.

That the band is narrow across unrelated architectures and training sets
is itself the finding: what limits them is common to all of them. They
are generic text encoders whose similarity geometry is organised around
distinctions that do not line up with DINOv2's. Changing which one is
used cannot fix that; changing how both towers are trained might, and
that variable has never been touched.

Also records the VG part-level oracle: annotator-supplied box-to-phrase
correspondence buys 0.023 (0.336 -&gt; 0.359), so part correspondence was
never the problem either.

Co-Authored-By: Claude &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Seven text encoders against a fixed DINOv2 vision side, priced by the
anchor bound rather than the retired field correlation:

  PPMI          0.289    BGE-large 335M   0.308
  MiniLM 22M    0.328    Qwen 0.5B        0.325
  mpnet 110M    0.341    Qwen 1.5B        0.311
  bert 110M     0.341    part-oracle ceiling 0.359

No correlation with scale and the largest model is not the best; a
retrieval-tuned 335M encoder is worse than bert-base. All seven sit in a
0.29-0.34 band against a part-oracle ceiling of 0.359, so swapping in a
stronger off-the-shelf encoder is closed as a route.

That the band is narrow across unrelated architectures and training sets
is itself the finding: what limits them is common to all of them. They
are generic text encoders whose similarity geometry is organised around
distinctions that do not line up with DINOv2's. Changing which one is
used cannot fix that; changing how both towers are trained might, and
that variable has never been touched.

Also records the VG part-level oracle: annotator-supplied box-to-phrase
correspondence buys 0.023 (0.336 -&gt; 0.359), so part correspondence was
never the problem either.

Co-Authored-By: Claude &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
</feed>
