<feed xmlns='http://www.w3.org/2005/Atom'>
<title>srm.git/models, branch main</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/'/>
<entry>
<title>Add HRM-Orth v1 (codex round 2 Q6 pivot)</title>
<updated>2026-05-23T17:04:04+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T17:04:04+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=fe4d92760f9d9ce9d9f41eb0fe69dd9eadc1534c'/>
<id>fe4d92760f9d9ce9d9f41eb0fe69dd9eadc1534c</id>
<content type='text'>
Patch HRM Block with Lipschitz-bounded ops:
- attention → cosine-normalized softmax attn
- SwiGLU → OrthLinear (Cayley + weak diag scale) + MaxMin + OrthLinear
- rms_norm + add → weighted residual (1-σ(w))·h + σ(w)·f(h)
- Weak orthogonality: diag(s) with s_i ∈ [0.95, 1.0] for compression directions

Keeps HRM ACT framework + H_level/L_level + cycles unchanged.

Predicted +5-7pp vs SRM v1 (codex Q5 decomp):
  +1.5-2.5 (remove ReLU rank-kill via MaxMin)
  +2.0-3.0 (remove AOL attenuation via Cayley)
  +1.0-1.5 (orthogonal residual flow)

Also adds: train_hrm_orth.py trainer, SRM v1 run logs, .gitignore ckpts/.codex

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Patch HRM Block with Lipschitz-bounded ops:
- attention → cosine-normalized softmax attn
- SwiGLU → OrthLinear (Cayley + weak diag scale) + MaxMin + OrthLinear
- rms_norm + add → weighted residual (1-σ(w))·h + σ(w)·f(h)
- Weak orthogonality: diag(s) with s_i ∈ [0.95, 1.0] for compression directions

Keeps HRM ACT framework + H_level/L_level + cycles unchanged.

Predicted +5-7pp vs SRM v1 (codex Q5 decomp):
  +1.5-2.5 (remove ReLU rank-kill via MaxMin)
  +2.0-3.0 (remove AOL attenuation via Cayley)
  +1.0-1.5 (orthogonal residual flow)

Also adds: train_hrm_orth.py trainer, SRM v1 run logs, .gitignore ckpts/.codex

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>SRM-AOL: codex review fixes</title>
<updated>2026-05-23T09:45:03+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T09:45:03+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=d11a0f6432e26c3243123d5e19aaf2702c76d64c'/>
<id>d11a0f6432e26c3243123d5e19aaf2702c76d64c</id>
<content type='text'>
- Soften exact Lipschitz claim — bf16 cast makes bound approximate (only exact in fp32)
- BlockGain init_diag 1.0 → 3.0: original gave 27% cross-coupling (mislabeled "minimal");
  3.0 gives ~5% which is what "minimal" should mean
- Note torch.compile risk with linalg.solve in CayleyOrthogonal

Per codex review of v1.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
- Soften exact Lipschitz claim — bf16 cast makes bound approximate (only exact in fp32)
- BlockGain init_diag 1.0 → 3.0: original gave 27% cross-coupling (mislabeled "minimal");
  3.0 gives ~5% which is what "minimal" should mean
- Note torch.compile risk with linalg.solve in CayleyOrthogonal

Per codex review of v1.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Add SRM-Joint-AOL v1 model</title>
<updated>2026-05-23T09:37:43+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T09:37:43+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=27b69c2b75a251ec39ece318c26ccb1a25d9fd79'/>
<id>27b69c2b75a251ec39ece318c26ccb1a25d9fd79</id>
<content type='text'>
Forked from HRM ACT framework. Replaces dual H_level/L_level transformer
stacks with a single joint operator T(h, l) that is provably contractive
under weighted P-norm with Lip_P(T) ≤ (1-α) + α·κ &lt; 1.

Per-step Lyapunov bound: λ_1 ≤ log((1-α) + α·κ).
With κ=0.86 → λ_1 ≤ -0.15 ≈ HRM success regime (no CF needed).

Components:
- AOLLinear: 1-Lipschitz via Prach &amp; Lampert rescaling (float32 normalization)
- AOLBlock: stack with ReLU (1-Lipschitz activation)
- CayleyOrthogonal: exact orthogonal cross-coupling
- BlockGain: softmax row-sum bound under P-norm
- AOLTokenMixer: 1-Lipschitz token + channel mixing

Smoke test passes: params=939k (hidden=256 test config),
forward OK, empirical Lip=0.17 &lt; theoretical bound 0.90.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Forked from HRM ACT framework. Replaces dual H_level/L_level transformer
stacks with a single joint operator T(h, l) that is provably contractive
under weighted P-norm with Lip_P(T) ≤ (1-α) + α·κ &lt; 1.

Per-step Lyapunov bound: λ_1 ≤ log((1-α) + α·κ).
With κ=0.86 → λ_1 ≤ -0.15 ≈ HRM success regime (no CF needed).

Components:
- AOLLinear: 1-Lipschitz via Prach &amp; Lampert rescaling (float32 normalization)
- AOLBlock: stack with ReLU (1-Lipschitz activation)
- CayleyOrthogonal: exact orthogonal cross-coupling
- BlockGain: softmax row-sum bound under P-norm
- AOLTokenMixer: 1-Lipschitz token + channel mixing

Smoke test passes: params=939k (hidden=256 test config),
forward OK, empirical Lip=0.17 &lt; theoretical bound 0.90.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Update layers.py</title>
<updated>2025-09-09T08:23:13+00:00</updated>
<author>
<name>raincchio</name>
<email>raincchio@gmail.com</email>
</author>
<published>2025-09-09T08:23:13+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=42410daaaf6ac8b266536d105a6e2362ffe40929'/>
<id>42410daaaf6ac8b266536d105a6e2362ffe40929</id>
<content type='text'>
remove the incorrect comment</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
remove the incorrect comment</pre>
</div>
</content>
</entry>
<entry>
<title>Update</title>
<updated>2025-07-21T10:40:40+00:00</updated>
<author>
<name>One</name>
<email>imone@tuta.io</email>
</author>
<published>2025-07-21T10:40:40+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=171e2fcde636bcb7e6c0073a9983ed5252f04753'/>
<id>171e2fcde636bcb7e6c0073a9983ed5252f04753</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Release</title>
<updated>2025-07-09T02:13:51+00:00</updated>
<author>
<name>One</name>
<email>imone@tuta.io</email>
</author>
<published>2025-07-09T02:13:51+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=bd6222774edcec1608a6842d0b06a637a4acef59'/>
<id>bd6222774edcec1608a6842d0b06a637a4acef59</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
