Merge master into main

1 files changed, 103 insertions, 0 deletions

diff --git a/runs/slurm_logs/15345523_scaled_grid_d4.out b/runs/slurm_logs/15345523_scaled_grid_d4.out
new file mode 100644
index 0000000..29ecb7f
--- /dev/null
+++ b/runs/slurm_logs/15345523_scaled_grid_d4.out
@@ -0,0 +1,103 @@
+============================================================
+SCALED REGULARIZATION GRID SEARCH - DEPTH 4
+Job ID: 15345523 | Node: gpub081
+Start: Mon Jan  5 05:47:15 CST 2026
+============================================================
+Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_squared, mult_log]
+Total: 12 experiments
+============================================================
+NVIDIA A40, 46068 MiB
+============================================================
+======================================================================
+SCALED REGULARIZATION GRID SEARCH
+======================================================================
+Depth: 4
+Epochs: 100
+Device: cuda
+GPU: NVIDIA A40
+======================================================================
+
+Grid: 4 λ_reg × 3 reg_types = 12 experiments
+λ_reg values: [0.01, 0.05, 0.1, 0.3]
+reg_types: ['mult_linear', 'mult_squared', 'mult_log']
+
+Loading CIFAR-100...
+Train: 50000, Test: 10000
+
+============================================================
+Config: depth=4, reg_type=mult_linear, λ_reg=0.01
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.482
+    Epoch  20: test=0.553
+    Epoch  30: test=0.584
+    Epoch  40: test=0.597
+    Epoch  50: test=0.603
+    Epoch  60: test=0.611
+    Epoch  70: test=0.611
+    Epoch  80: test=0.616
+    Epoch  90: test=0.621
+    Epoch 100: test=0.620
+  Training Lyapunov (mult_linear, λ_reg=0.01)...
+    Epoch  10: test=0.462 λ=1.872
+    Epoch  20: test=0.537 λ=1.833
+    Epoch  30: test=0.568 λ=1.815
+    Epoch  40: test=0.580 λ=1.802
+    Epoch  50: test=0.568 λ=1.793
+    Epoch  60: test=0.586 λ=1.794
+    Epoch  70: test=0.592 λ=1.794
+    Epoch  80: test=0.592 λ=1.793
+    Epoch  90: test=0.595 λ=1.796
+    Epoch 100: test=0.589 λ=1.795
+  Result: Vanilla=0.621, Lyap=0.595, Δ=-0.026
+
+============================================================
+Config: depth=4, reg_type=mult_squared, λ_reg=0.01
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.512
+    Epoch  20: test=0.552
+    Epoch  30: test=0.579
+    Epoch  40: test=0.586
+    Epoch  50: test=0.596
+    Epoch  60: test=0.609
+    Epoch  70: test=0.610
+    Epoch  80: test=0.616
+    Epoch  90: test=0.618
+    Epoch 100: test=0.617
+  Training Lyapunov (mult_squared, λ_reg=0.01)...
+    Epoch  10: test=0.101 λ=1.471
+    Epoch  20: test=0.057 λ=1.450
+    Epoch  30: test=0.036 λ=1.447
+    Epoch  40: test=0.017 λ=1.448
+    Epoch  50: test=0.033 λ=1.454
+    Epoch  60: test=0.044 λ=1.457
+    Epoch  70: test=0.038 λ=1.457
+    Epoch  80: test=0.035 λ=1.454
+    Epoch  90: test=0.044 λ=1.457
+    Epoch 100: test=0.035 λ=1.456
+  Result: Vanilla=0.618, Lyap=0.101, Δ=-0.517
+
+============================================================
+Config: depth=4, reg_type=mult_log, λ_reg=0.01
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.483
+    Epoch  20: test=0.548
+    Epoch  30: test=0.578
+    Epoch  40: test=0.597
+    Epoch  50: test=0.600
+    Epoch  60: test=0.609
+    Epoch  70: test=0.614
+    Epoch  80: test=0.610
+    Epoch  90: test=0.617
+    Epoch 100: test=0.618
+  Training Lyapunov (mult_log, λ_reg=0.01)...
+    Epoch  10: test=0.481 λ=1.889
+    Epoch  20: test=0.543 λ=1.852
+    Epoch  30: test=0.577 λ=1.841
+    Epoch  40: test=0.586 λ=1.841
+    Epoch  50: test=0.595 λ=1.842
+    Epoch  60: test=0.607 λ=1.846
+    Epoch  70: test=0.612 λ=1.854
+    Epoch  80: test=0.614 λ=1.855