<feed xmlns='http://www.w3.org/2005/Atom'>
<title>srm.git, branch main</title>
<subtitle>Unnamed repository; edit this file 'description' to name the repository.
</subtitle>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/'/>
<entry>
<title>gitignore: exclude /ckpts and /.codex</title>
<updated>2026-05-23T17:04:14+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T17:04:14+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=df1c768f46816cca8eab519d496e756e0d0f1196'/>
<id>df1c768f46816cca8eab519d496e756e0d0f1196</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Add HRM-Orth v1 (codex round 2 Q6 pivot)</title>
<updated>2026-05-23T17:04:04+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T17:04:04+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=fe4d92760f9d9ce9d9f41eb0fe69dd9eadc1534c'/>
<id>fe4d92760f9d9ce9d9f41eb0fe69dd9eadc1534c</id>
<content type='text'>
Patch HRM Block with Lipschitz-bounded ops:
- attention → cosine-normalized softmax attn
- SwiGLU → OrthLinear (Cayley + weak diag scale) + MaxMin + OrthLinear
- rms_norm + add → weighted residual (1-σ(w))·h + σ(w)·f(h)
- Weak orthogonality: diag(s) with s_i ∈ [0.95, 1.0] for compression directions

Keeps HRM ACT framework + H_level/L_level + cycles unchanged.

Predicted +5-7pp vs SRM v1 (codex Q5 decomp):
  +1.5-2.5 (remove ReLU rank-kill via MaxMin)
  +2.0-3.0 (remove AOL attenuation via Cayley)
  +1.0-1.5 (orthogonal residual flow)

Also adds: train_hrm_orth.py trainer, SRM v1 run logs, .gitignore ckpts/.codex

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Patch HRM Block with Lipschitz-bounded ops:
- attention → cosine-normalized softmax attn
- SwiGLU → OrthLinear (Cayley + weak diag scale) + MaxMin + OrthLinear
- rms_norm + add → weighted residual (1-σ(w))·h + σ(w)·f(h)
- Weak orthogonality: diag(s) with s_i ∈ [0.95, 1.0] for compression directions

Keeps HRM ACT framework + H_level/L_level + cycles unchanged.

Predicted +5-7pp vs SRM v1 (codex Q5 decomp):
  +1.5-2.5 (remove ReLU rank-kill via MaxMin)
  +2.0-3.0 (remove AOL attenuation via Cayley)
  +1.0-1.5 (orthogonal residual flow)

Also adds: train_hrm_orth.py trainer, SRM v1 run logs, .gitignore ckpts/.codex

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Add SRM training pipeline</title>
<updated>2026-05-23T09:56:47+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T09:56:47+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=152821462023690df5d2bf90812e1cb5b1ca7274'/>
<id>152821462023690df5d2bf90812e1cb5b1ca7274</id>
<content type='text'>
- config/arch/srm_v1.yaml: arch config for pretrain.py integration
- scripts/train_srm.py: standalone from-scratch trainer based on step4
  (HRM training infra adapted for SRM joint operator)

The arch.yaml exposes κ, η, α, n_iters, n_aol_layers as Hydra params.

train_srm.py adds joint Lyapunov diagnostic via JVP on srm_block to verify
λ_1 ≤ log((1-α)+α·κ) per micro-step. Smoke tested with hidden=128, n_iters=4
on Sudoku 1k: empirical Lip 0.28 &lt;&lt; bound 0.90.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
- config/arch/srm_v1.yaml: arch config for pretrain.py integration
- scripts/train_srm.py: standalone from-scratch trainer based on step4
  (HRM training infra adapted for SRM joint operator)

The arch.yaml exposes κ, η, α, n_iters, n_aol_layers as Hydra params.

train_srm.py adds joint Lyapunov diagnostic via JVP on srm_block to verify
λ_1 ≤ log((1-α)+α·κ) per micro-step. Smoke tested with hidden=128, n_iters=4
on Sudoku 1k: empirical Lip 0.28 &lt;&lt; bound 0.90.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>SRM-AOL: codex review fixes</title>
<updated>2026-05-23T09:45:03+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T09:45:03+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=d11a0f6432e26c3243123d5e19aaf2702c76d64c'/>
<id>d11a0f6432e26c3243123d5e19aaf2702c76d64c</id>
<content type='text'>
- Soften exact Lipschitz claim — bf16 cast makes bound approximate (only exact in fp32)
- BlockGain init_diag 1.0 → 3.0: original gave 27% cross-coupling (mislabeled "minimal");
  3.0 gives ~5% which is what "minimal" should mean
- Note torch.compile risk with linalg.solve in CayleyOrthogonal

Per codex review of v1.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
- Soften exact Lipschitz claim — bf16 cast makes bound approximate (only exact in fp32)
- BlockGain init_diag 1.0 → 3.0: original gave 27% cross-coupling (mislabeled "minimal");
  3.0 gives ~5% which is what "minimal" should mean
- Note torch.compile risk with linalg.solve in CayleyOrthogonal

Per codex review of v1.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Add SRM-Joint-AOL v1 model</title>
<updated>2026-05-23T09:37:43+00:00</updated>
<author>
<name>YurenHao0426</name>
<email>Blackhao0426@gmail.com</email>
</author>
<published>2026-05-23T09:37:43+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=27b69c2b75a251ec39ece318c26ccb1a25d9fd79'/>
<id>27b69c2b75a251ec39ece318c26ccb1a25d9fd79</id>
<content type='text'>
Forked from HRM ACT framework. Replaces dual H_level/L_level transformer
stacks with a single joint operator T(h, l) that is provably contractive
under weighted P-norm with Lip_P(T) ≤ (1-α) + α·κ &lt; 1.

Per-step Lyapunov bound: λ_1 ≤ log((1-α) + α·κ).
With κ=0.86 → λ_1 ≤ -0.15 ≈ HRM success regime (no CF needed).

Components:
- AOLLinear: 1-Lipschitz via Prach &amp; Lampert rescaling (float32 normalization)
- AOLBlock: stack with ReLU (1-Lipschitz activation)
- CayleyOrthogonal: exact orthogonal cross-coupling
- BlockGain: softmax row-sum bound under P-norm
- AOLTokenMixer: 1-Lipschitz token + channel mixing

Smoke test passes: params=939k (hidden=256 test config),
forward OK, empirical Lip=0.17 &lt; theoretical bound 0.90.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
Forked from HRM ACT framework. Replaces dual H_level/L_level transformer
stacks with a single joint operator T(h, l) that is provably contractive
under weighted P-norm with Lip_P(T) ≤ (1-α) + α·κ &lt; 1.

Per-step Lyapunov bound: λ_1 ≤ log((1-α) + α·κ).
With κ=0.86 → λ_1 ≤ -0.15 ≈ HRM success regime (no CF needed).

Components:
- AOLLinear: 1-Lipschitz via Prach &amp; Lampert rescaling (float32 normalization)
- AOLBlock: stack with ReLU (1-Lipschitz activation)
- CayleyOrthogonal: exact orthogonal cross-coupling
- BlockGain: softmax row-sum bound under P-norm
- AOLTokenMixer: 1-Lipschitz token + channel mixing

Smoke test passes: params=939k (hidden=256 test config),
forward OK, empirical Lip=0.17 &lt; theoretical bound 0.90.

Co-Authored-By: Claude Opus 4.7 &lt;noreply@anthropic.com&gt;
</pre>
</div>
</content>
</entry>
<entry>
<title>Update README with paper link and Discord community</title>
<updated>2026-03-31T23:08:31+00:00</updated>
<author>
<name>WC-william</name>
<email>72850088+WC-william@users.noreply.github.com</email>
</author>
<published>2026-03-31T23:08:31+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=ac15626f8db096a63c775b84c9dc868776a6feda'/>
<id>ac15626f8db096a63c775b84c9dc868776a6feda</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Update layers.py</title>
<updated>2025-09-09T08:23:13+00:00</updated>
<author>
<name>raincchio</name>
<email>raincchio@gmail.com</email>
</author>
<published>2025-09-09T08:23:13+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=42410daaaf6ac8b266536d105a6e2362ffe40929'/>
<id>42410daaaf6ac8b266536d105a6e2362ffe40929</id>
<content type='text'>
remove the incorrect comment</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
remove the incorrect comment</pre>
</div>
</content>
</entry>
<entry>
<title>Added Discord info</title>
<updated>2025-08-31T03:12:26+00:00</updated>
<author>
<name>WC-william</name>
<email>72850088+WC-william@users.noreply.github.com</email>
</author>
<published>2025-08-31T03:12:26+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=05dd4ef795a98c20110e380a330d0b3ec159a46b'/>
<id>05dd4ef795a98c20110e380a330d0b3ec159a46b</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
<entry>
<title>Merge pull request #17 from btoo/patch-1</title>
<updated>2025-08-03T15:55:33+00:00</updated>
<author>
<name>One</name>
<email>imoneoi@users.noreply.github.com</email>
</author>
<published>2025-08-03T15:55:33+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=4047578a02e5deba975c38a1f32392547e66c071'/>
<id>4047578a02e5deba975c38a1f32392547e66c071</id>
<content type='text'>
use bibtex syntax highlighting for citation in README.md</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
use bibtex syntax highlighting for citation in README.md</pre>
</div>
</content>
</entry>
<entry>
<title>use bibtex syntax highlighting for citation in README.md</title>
<updated>2025-08-03T03:31:44+00:00</updated>
<author>
<name>btoo</name>
<email>8883465+btoo@users.noreply.github.com</email>
</author>
<published>2025-08-03T03:29:58+00:00</published>
<link rel='alternate' type='text/html' href='https://git.blackhao.com/srm.git/commit/?id=1db0cf528328dcdd136473f58db0125e516c16c6'/>
<id>1db0cf528328dcdd136473f58db0125e516c16c6</id>
<content type='text'>
</content>
<content type='xhtml'>
<div xmlns='http://www.w3.org/1999/xhtml'>
<pre>
</pre>
</div>
</content>
</entry>
</feed>
