init commit

1 files changed, 266 insertions, 0 deletions

diff --git a/runs/slurm_logs/15427300_scaled_grid_d4.out b/runs/slurm_logs/15427300_scaled_grid_d4.out
new file mode 100644
index 0000000..a8ca1d9
--- /dev/null
+++ b/runs/slurm_logs/15427300_scaled_grid_d4.out
@@ -0,0 +1,266 @@
+============================================================
+SCALED REGULARIZATION GRID SEARCH - DEPTH 4
+Job ID: 15427300 | Node: gpub003
+Start: Tue Jan  6 21:27:43 CST 2026
+============================================================
+Grid: λ_reg=[0.0005, 0.001, 0.002, 0.005] × reg_type=[mult_linear, mult_log]
+Total: 8 experiments
+============================================================
+NVIDIA A40, 46068 MiB
+============================================================
+======================================================================
+SCALED REGULARIZATION GRID SEARCH
+======================================================================
+Depth: 4
+Epochs: 100
+Device: cuda
+GPU: NVIDIA A40
+======================================================================
+
+Grid: 4 λ_reg × 2 reg_types = 8 experiments
+λ_reg values: [0.0005, 0.001, 0.002, 0.005]
+reg_types: ['mult_linear', 'mult_log']
+
+Loading CIFAR-100...
+Train: 50000, Test: 10000
+
+============================================================
+Config: depth=4, reg_type=mult_linear, λ_reg=0.0005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.504
+    Epoch  20: test=0.554
+    Epoch  30: test=0.582
+    Epoch  40: test=0.604
+    Epoch  50: test=0.607
+    Epoch  60: test=0.614
+    Epoch  70: test=0.618
+    Epoch  80: test=0.620
+    Epoch  90: test=0.622
+    Epoch 100: test=0.619
+  Training Lyapunov (mult_linear, λ_reg=0.0005)...
+    Epoch  10: test=0.491 λ=1.881
+    Epoch  20: test=0.561 λ=1.843
+    Epoch  30: test=0.587 λ=1.837
+    Epoch  40: test=0.596 λ=1.835
+    Epoch  50: test=0.604 λ=1.831
+    Epoch  60: test=0.613 λ=1.842
+    Epoch  70: test=0.619 λ=1.842
+    Epoch  80: test=0.625 λ=1.851
+    Epoch  90: test=0.626 λ=1.853
+    Epoch 100: test=0.626 λ=1.855
+  Result: Vanilla=0.622, Lyap=0.626, Δ=+0.004
+
+============================================================
+Config: depth=4, reg_type=mult_log, λ_reg=0.0005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.502
+    Epoch  20: test=0.558
+    Epoch  30: test=0.584
+    Epoch  40: test=0.592
+    Epoch  50: test=0.605
+    Epoch  60: test=0.611
+    Epoch  70: test=0.614
+    Epoch  80: test=0.618
+    Epoch  90: test=0.622
+    Epoch 100: test=0.627
+  Training Lyapunov (mult_log, λ_reg=0.0005)...
+    Epoch  10: test=0.492 λ=1.898
+    Epoch  20: test=0.555 λ=1.862
+    Epoch  30: test=0.582 λ=1.859
+    Epoch  40: test=0.596 λ=1.856
+    Epoch  50: test=0.610 λ=1.860
+    Epoch  60: test=0.615 λ=1.863
+    Epoch  70: test=0.618 λ=1.866
+    Epoch  80: test=0.624 λ=1.871
+    Epoch  90: test=0.623 λ=1.872
+    Epoch 100: test=0.626 λ=1.873
+  Result: Vanilla=0.627, Lyap=0.626, Δ=-0.002
+
+============================================================
+Config: depth=4, reg_type=mult_linear, λ_reg=0.001
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.486
+    Epoch  20: test=0.568
+    Epoch  30: test=0.588
+    Epoch  40: test=0.592
+    Epoch  50: test=0.604
+    Epoch  60: test=0.614
+    Epoch  70: test=0.620
+    Epoch  80: test=0.619
+    Epoch  90: test=0.625
+    Epoch 100: test=0.623
+  Training Lyapunov (mult_linear, λ_reg=0.001)...
+    Epoch  10: test=0.495 λ=1.894
+    Epoch  20: test=0.562 λ=1.857
+    Epoch  30: test=0.585 λ=1.854
+    Epoch  40: test=0.591 λ=1.848
+    Epoch  50: test=0.604 λ=1.851
+    Epoch  60: test=0.613 λ=1.852
+    Epoch  70: test=0.623 λ=1.864
+    Epoch  80: test=0.624 λ=1.866
+    Epoch  90: test=0.620 λ=1.863
+    Epoch 100: test=0.627 λ=1.868
+  Result: Vanilla=0.625, Lyap=0.627, Δ=+0.002
+
+============================================================
+Config: depth=4, reg_type=mult_log, λ_reg=0.001
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.500
+    Epoch  20: test=0.563
+    Epoch  30: test=0.587
+    Epoch  40: test=0.596
+    Epoch  50: test=0.603
+    Epoch  60: test=0.613
+    Epoch  70: test=0.616
+    Epoch  80: test=0.622
+    Epoch  90: test=0.623
+    Epoch 100: test=0.623
+  Training Lyapunov (mult_log, λ_reg=0.001)...
+    Epoch  10: test=0.509 λ=1.885
+    Epoch  20: test=0.555 λ=1.847
+    Epoch  30: test=0.582 λ=1.835
+    Epoch  40: test=0.595 λ=1.831
+    Epoch  50: test=0.612 λ=1.836
+    Epoch  60: test=0.619 λ=1.840
+    Epoch  70: test=0.626 λ=1.840
+    Epoch  80: test=0.625 λ=1.843
+    Epoch  90: test=0.629 λ=1.849
+    Epoch 100: test=0.627 λ=1.850
+  Result: Vanilla=0.623, Lyap=0.629, Δ=+0.007
+
+============================================================
+Config: depth=4, reg_type=mult_linear, λ_reg=0.002
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.492
+    Epoch  20: test=0.563
+    Epoch  30: test=0.568
+    Epoch  40: test=0.594
+    Epoch  50: test=0.601
+    Epoch  60: test=0.613
+    Epoch  70: test=0.618
+    Epoch  80: test=0.620
+    Epoch  90: test=0.623
+    Epoch 100: test=0.624
+  Training Lyapunov (mult_linear, λ_reg=0.002)...
+    Epoch  10: test=0.495 λ=1.891
+    Epoch  20: test=0.546 λ=1.854
+    Epoch  30: test=0.577 λ=1.844
+    Epoch  40: test=0.591 λ=1.836
+    Epoch  50: test=0.603 λ=1.849
+    Epoch  60: test=0.605 λ=1.848
+    Epoch  70: test=0.609 λ=1.851
+    Epoch  80: test=0.623 λ=1.856
+    Epoch  90: test=0.619 λ=1.858
+    Epoch 100: test=0.619 λ=1.857
+  Result: Vanilla=0.624, Lyap=0.623, Δ=-0.001
+
+============================================================
+Config: depth=4, reg_type=mult_log, λ_reg=0.002
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.489
+    Epoch  20: test=0.557
+    Epoch  30: test=0.585
+    Epoch  40: test=0.581
+    Epoch  50: test=0.613
+    Epoch  60: test=0.607
+    Epoch  70: test=0.619
+    Epoch  80: test=0.622
+    Epoch  90: test=0.625
+    Epoch 100: test=0.626
+  Training Lyapunov (mult_log, λ_reg=0.002)...
+    Epoch  10: test=0.494 λ=1.890
+    Epoch  20: test=0.559 λ=1.843
+    Epoch  30: test=0.586 λ=1.831
+    Epoch  40: test=0.603 λ=1.826
+    Epoch  50: test=0.608 λ=1.829
+    Epoch  60: test=0.615 λ=1.844
+    Epoch  70: test=0.619 λ=1.853
+    Epoch  80: test=0.623 λ=1.856
+    Epoch  90: test=0.623 λ=1.853
+    Epoch 100: test=0.626 λ=1.852
+  Result: Vanilla=0.626, Lyap=0.626, Δ=-0.001
+
+============================================================
+Config: depth=4, reg_type=mult_linear, λ_reg=0.005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.491
+    Epoch  20: test=0.558
+    Epoch  30: test=0.583
+    Epoch  40: test=0.600
+    Epoch  50: test=0.600
+    Epoch  60: test=0.609
+    Epoch  70: test=0.613
+    Epoch  80: test=0.615
+    Epoch  90: test=0.621
+    Epoch 100: test=0.623
+  Training Lyapunov (mult_linear, λ_reg=0.005)...
+    Epoch  10: test=0.504 λ=1.864
+    Epoch  20: test=0.547 λ=1.848
+    Epoch  30: test=0.588 λ=1.839
+    Epoch  40: test=0.597 λ=1.830
+    Epoch  50: test=0.604 λ=1.833
+    Epoch  60: test=0.610 λ=1.840
+    Epoch  70: test=0.617 λ=1.850
+    Epoch  80: test=0.618 λ=1.852
+    Epoch  90: test=0.623 λ=1.857
+    Epoch 100: test=0.625 λ=1.851
+  Result: Vanilla=0.623, Lyap=0.625, Δ=+0.002
+
+============================================================
+Config: depth=4, reg_type=mult_log, λ_reg=0.005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.485
+    Epoch  20: test=0.550
+    Epoch  30: test=0.576
+    Epoch  40: test=0.586
+    Epoch  50: test=0.598
+    Epoch  60: test=0.611
+    Epoch  70: test=0.613
+    Epoch  80: test=0.618
+    Epoch  90: test=0.621
+    Epoch 100: test=0.619
+  Training Lyapunov (mult_log, λ_reg=0.005)...
+    Epoch  10: test=0.497 λ=1.872
+    Epoch  20: test=0.556 λ=1.833
+    Epoch  30: test=0.586 λ=1.826
+    Epoch  40: test=0.598 λ=1.825
+    Epoch  50: test=0.610 λ=1.835
+    Epoch  60: test=0.619 λ=1.838
+    Epoch  70: test=0.625 λ=1.847
+    Epoch  80: test=0.626 λ=1.850
+    Epoch  90: test=0.628 λ=1.852
+    Epoch 100: test=0.628 λ=1.851
+  Result: Vanilla=0.621, Lyap=0.628, Δ=+0.007
+
+======================================================================
+SUMMARY: DEPTH = 4
+======================================================================
+reg_type            λ_reg  Vanilla Lyapunov        Δ  Final λ
+----------------------------------------------------------------------
+mult_linear          0.00    0.622    0.626   +0.004    1.855
+mult_log             0.00    0.627    0.626   -0.002    1.873
+mult_linear          0.00    0.625    0.627   +0.002    1.868
+mult_log             0.00    0.623    0.629   +0.007    1.850
+mult_linear          0.00    0.624    0.623   -0.001    1.857
+mult_log             0.00    0.626    0.626   -0.001    1.852
+mult_linear          0.01    0.623    0.625   +0.002    1.851
+mult_log             0.01    0.621    0.628   +0.007    1.851
+----------------------------------------------------------------------
+BEST: mult_log, λ_reg=0.001 → 0.629 (Δ=+0.007)
+
+Results saved to: ./runs/scaled_grid/depth4_results.json
+
+======================================================================
+GRID SEARCH COMPLETE
+======================================================================
+============================================================
+Finished: Wed Jan  7 09:04:04 CST 2026
+============================================================