init commit

1 files changed, 266 insertions, 0 deletions

diff --git a/runs/slurm_logs/15427305_scaled_grid_d12.out b/runs/slurm_logs/15427305_scaled_grid_d12.out
new file mode 100644
index 0000000..2b213b1
--- /dev/null
+++ b/runs/slurm_logs/15427305_scaled_grid_d12.out
@@ -0,0 +1,266 @@
+============================================================
+SCALED REGULARIZATION GRID SEARCH - DEPTH 12
+Job ID: 15427305 | Node: gpub063
+Start: Tue Jan  6 22:02:22 CST 2026
+============================================================
+Grid: λ_reg=[0.0005, 0.001, 0.002, 0.005] × reg_type=[mult_linear, mult_log]
+Total: 8 experiments
+============================================================
+NVIDIA A40, 46068 MiB
+============================================================
+======================================================================
+SCALED REGULARIZATION GRID SEARCH
+======================================================================
+Depth: 12
+Epochs: 100
+Device: cuda
+GPU: NVIDIA A40
+======================================================================
+
+Grid: 4 λ_reg × 2 reg_types = 8 experiments
+λ_reg values: [0.0005, 0.001, 0.002, 0.005]
+reg_types: ['mult_linear', 'mult_log']
+
+Loading CIFAR-100...
+Train: 50000, Test: 10000
+
+============================================================
+Config: depth=12, reg_type=mult_linear, λ_reg=0.0005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.265
+    Epoch  20: test=0.341
+    Epoch  30: test=0.399
+    Epoch  40: test=0.435
+    Epoch  50: test=0.409
+    Epoch  60: test=0.445
+    Epoch  70: test=0.446
+    Epoch  80: test=0.446
+    Epoch  90: test=0.456
+    Epoch 100: test=0.452
+  Training Lyapunov (mult_linear, λ_reg=0.0005)...
+    Epoch  10: test=0.010 λ=1.717
+    Epoch  20: test=0.010 λ=1.716
+    Epoch  30: test=0.010 λ=1.687
+    Epoch  40: test=0.010 λ=1.671
+    Epoch  50: test=0.011 λ=1.669
+    Epoch  60: test=0.010 λ=1.650
+    Epoch  70: test=0.010 λ=1.651
+    Epoch  80: test=0.011 λ=1.620
+    Epoch  90: test=0.011 λ=1.623
+    Epoch 100: test=0.010 λ=1.621
+  Result: Vanilla=0.456, Lyap=0.011, Δ=-0.445
+
+============================================================
+Config: depth=12, reg_type=mult_log, λ_reg=0.0005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.224
+    Epoch  20: test=0.332
+    Epoch  30: test=0.388
+    Epoch  40: test=0.421
+    Epoch  50: test=0.448
+    Epoch  60: test=0.458
+    Epoch  70: test=0.465
+    Epoch  80: test=0.456
+    Epoch  90: test=0.477
+    Epoch 100: test=0.464
+  Training Lyapunov (mult_log, λ_reg=0.0005)...
+    Epoch  10: test=0.010 λ=1.726
+    Epoch  20: test=0.013 λ=1.629
+    Epoch  30: test=0.010 λ=1.602
+    Epoch  40: test=0.010 λ=1.596
+    Epoch  50: test=0.010 λ=1.606
+    Epoch  60: test=0.010 λ=1.577
+    Epoch  70: test=0.010 λ=1.570
+    Epoch  80: test=0.010 λ=1.572
+    Epoch  90: test=0.010 λ=1.563
+    Epoch 100: test=0.010 λ=1.566
+  Result: Vanilla=0.477, Lyap=0.013, Δ=-0.464
+
+============================================================
+Config: depth=12, reg_type=mult_linear, λ_reg=0.001
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.249
+    Epoch  20: test=0.338
+    Epoch  30: test=0.378
+    Epoch  40: test=0.429
+    Epoch  50: test=0.452
+    Epoch  60: test=0.447
+    Epoch  70: test=0.484
+    Epoch  80: test=0.482
+    Epoch  90: test=0.489
+    Epoch 100: test=0.478
+  Training Lyapunov (mult_linear, λ_reg=0.001)...
+    Epoch  10: test=0.012 λ=1.695
+    Epoch  20: test=0.011 λ=1.636
+    Epoch  30: test=0.010 λ=1.673
+    Epoch  40: test=0.009 λ=1.658
+    Epoch  50: test=0.010 λ=1.653
+    Epoch  60: test=0.009 λ=1.622
+    Epoch  70: test=0.008 λ=1.618
+    Epoch  80: test=0.010 λ=1.611
+    Epoch  90: test=0.012 λ=1.615
+    Epoch 100: test=0.011 λ=1.604
+  Result: Vanilla=0.489, Lyap=0.012, Δ=-0.477
+
+============================================================
+Config: depth=12, reg_type=mult_log, λ_reg=0.001
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.182
+    Epoch  20: test=0.285
+    Epoch  30: test=0.326
+    Epoch  40: test=0.375
+    Epoch  50: test=0.392
+    Epoch  60: test=0.407
+    Epoch  70: test=0.406
+    Epoch  80: test=0.427
+    Epoch  90: test=0.414
+    Epoch 100: test=0.438
+  Training Lyapunov (mult_log, λ_reg=0.001)...
+    Epoch  10: test=0.018 λ=1.729
+    Epoch  20: test=0.010 λ=1.665
+    Epoch  30: test=0.010 λ=1.635
+    Epoch  40: test=0.010 λ=1.640
+    Epoch  50: test=0.011 λ=1.638
+    Epoch  60: test=0.010 λ=1.616
+    Epoch  70: test=0.010 λ=1.597
+    Epoch  80: test=0.010 λ=1.606
+    Epoch  90: test=0.010 λ=1.613
+    Epoch 100: test=0.010 λ=1.602
+  Result: Vanilla=0.438, Lyap=0.018, Δ=-0.420
+
+============================================================
+Config: depth=12, reg_type=mult_linear, λ_reg=0.002
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.242
+    Epoch  20: test=0.345
+    Epoch  30: test=0.387
+    Epoch  40: test=0.418
+    Epoch  50: test=0.458
+    Epoch  60: test=0.462
+    Epoch  70: test=0.469
+    Epoch  80: test=0.474
+    Epoch  90: test=0.481
+    Epoch 100: test=0.485
+  Training Lyapunov (mult_linear, λ_reg=0.002)...
+    Epoch  10: test=0.015 λ=1.689
+    Epoch  20: test=0.011 λ=1.704
+    Epoch  30: test=0.010 λ=1.671
+    Epoch  40: test=0.010 λ=1.629
+    Epoch  50: test=0.010 λ=1.615
+    Epoch  60: test=0.010 λ=1.603
+    Epoch  70: test=0.010 λ=1.602
+    Epoch  80: test=0.013 λ=1.598
+    Epoch  90: test=0.010 λ=1.594
+    Epoch 100: test=0.009 λ=1.596
+  Result: Vanilla=0.485, Lyap=0.015, Δ=-0.470
+
+============================================================
+Config: depth=12, reg_type=mult_log, λ_reg=0.002
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.181
+    Epoch  20: test=0.296
+    Epoch  30: test=0.388
+    Epoch  40: test=0.424
+    Epoch  50: test=0.428
+    Epoch  60: test=0.444
+    Epoch  70: test=0.444
+    Epoch  80: test=0.458
+    Epoch  90: test=0.469
+    Epoch 100: test=0.466
+  Training Lyapunov (mult_log, λ_reg=0.002)...
+    Epoch  10: test=0.010 λ=1.717
+    Epoch  20: test=0.010 λ=1.650
+    Epoch  30: test=0.010 λ=1.643
+    Epoch  40: test=0.011 λ=1.682
+    Epoch  50: test=0.010 λ=1.652
+    Epoch  60: test=0.010 λ=1.623
+    Epoch  70: test=0.010 λ=1.632
+    Epoch  80: test=0.010 λ=1.631
+    Epoch  90: test=0.010 λ=1.613
+    Epoch 100: test=0.010 λ=1.613
+  Result: Vanilla=0.469, Lyap=0.011, Δ=-0.458
+
+============================================================
+Config: depth=12, reg_type=mult_linear, λ_reg=0.005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.177
+    Epoch  20: test=0.270
+    Epoch  30: test=0.385
+    Epoch  40: test=0.422
+    Epoch  50: test=0.438
+    Epoch  60: test=0.426
+    Epoch  70: test=0.448
+    Epoch  80: test=0.467
+    Epoch  90: test=0.468
+    Epoch 100: test=0.469
+  Training Lyapunov (mult_linear, λ_reg=0.005)...
+    Epoch  10: test=0.013 λ=1.662
+    Epoch  20: test=0.010 λ=1.668
+    Epoch  30: test=0.009 λ=1.604
+    Epoch  40: test=0.010 λ=1.588
+    Epoch  50: test=0.010 λ=1.620
+    Epoch  60: test=0.010 λ=1.589
+    Epoch  70: test=0.010 λ=1.594
+    Epoch  80: test=0.010 λ=1.596
+    Epoch  90: test=0.010 λ=1.600
+    Epoch 100: test=0.010 λ=1.600
+  Result: Vanilla=0.469, Lyap=0.013, Δ=-0.456
+
+============================================================
+Config: depth=12, reg_type=mult_log, λ_reg=0.005
+============================================================
+  Training Vanilla...
+    Epoch  10: test=0.219
+    Epoch  20: test=0.357
+    Epoch  30: test=0.388
+    Epoch  40: test=0.382
+    Epoch  50: test=0.399
+    Epoch  60: test=0.428
+    Epoch  70: test=0.430
+    Epoch  80: test=0.460
+    Epoch  90: test=0.454
+    Epoch 100: test=0.463
+  Training Lyapunov (mult_log, λ_reg=0.005)...
+    Epoch  10: test=0.017 λ=1.706
+    Epoch  20: test=0.010 λ=1.681
+    Epoch  30: test=0.009 λ=1.616
+    Epoch  40: test=0.010 λ=1.610
+    Epoch  50: test=0.010 λ=1.639
+    Epoch  60: test=0.010 λ=1.610
+    Epoch  70: test=0.010 λ=1.600
+    Epoch  80: test=0.010 λ=1.632
+    Epoch  90: test=0.010 λ=1.607
+    Epoch 100: test=0.010 λ=1.602
+  Result: Vanilla=0.463, Lyap=0.017, Δ=-0.446
+
+======================================================================
+SUMMARY: DEPTH = 12
+======================================================================
+reg_type            λ_reg  Vanilla Lyapunov        Δ  Final λ
+----------------------------------------------------------------------
+mult_linear          0.00    0.456    0.011   -0.445    1.621
+mult_log             0.00    0.477    0.013   -0.464    1.566
+mult_linear          0.00    0.489    0.012   -0.477    1.604
+mult_log             0.00    0.438    0.018   -0.420    1.602
+mult_linear          0.00    0.485    0.015   -0.470    1.596
+mult_log             0.00    0.469    0.011   -0.458    1.613
+mult_linear          0.01    0.469    0.013   -0.456    1.600
+mult_log             0.01    0.463    0.017   -0.446    1.602
+----------------------------------------------------------------------
+BEST: mult_log, λ_reg=0.001 → 0.018 (Δ=-0.420)
+
+Results saved to: ./runs/scaled_grid/depth12_results.json
+
+======================================================================
+GRID SEARCH COMPLETE
+======================================================================
+============================================================
+Finished: Thu Jan  8 08:44:00 CST 2026
+============================================================