1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
|
============================================================
SCALED REGULARIZATION GRID SEARCH - DEPTH 12
Job ID: 15345525 | Node: gpub082
Start: Mon Jan 5 05:47:15 CST 2026
============================================================
Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_squared, mult_log]
Total: 12 experiments
============================================================
NVIDIA A40, 46068 MiB
============================================================
======================================================================
SCALED REGULARIZATION GRID SEARCH
======================================================================
Depth: 12
Epochs: 100
Device: cuda
GPU: NVIDIA A40
======================================================================
Grid: 4 λ_reg × 3 reg_types = 12 experiments
λ_reg values: [0.01, 0.05, 0.1, 0.3]
reg_types: ['mult_linear', 'mult_squared', 'mult_log']
Loading CIFAR-100...
Train: 50000, Test: 10000
============================================================
Config: depth=12, reg_type=mult_linear, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.226
Epoch 20: test=0.313
Epoch 30: test=0.385
Epoch 40: test=0.432
Epoch 50: test=0.453
Epoch 60: test=0.460
Epoch 70: test=0.464
Epoch 80: test=0.479
Epoch 90: test=0.474
Epoch 100: test=0.476
Training Lyapunov (mult_linear, λ_reg=0.01)...
Epoch 10: test=0.010 λ=1.644
Epoch 20: test=0.015 λ=1.622
Epoch 30: test=0.010 λ=1.605
Epoch 40: test=0.010 λ=1.624
Epoch 50: test=0.010 λ=1.626
Epoch 60: test=0.010 λ=1.600
Epoch 70: test=0.010 λ=1.599
Epoch 80: test=0.010 λ=1.596
Epoch 90: test=0.010 λ=1.600
Epoch 100: test=0.010 λ=1.600
Result: Vanilla=0.479, Lyap=0.015, Δ=-0.464
============================================================
Config: depth=12, reg_type=mult_squared, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.247
Epoch 20: test=0.356
Epoch 30: test=0.363
Epoch 40: test=0.409
Epoch 50: test=0.408
Epoch 60: test=0.426
Epoch 70: test=0.446
Epoch 80: test=0.460
Epoch 90: test=0.463
Epoch 100: test=0.470
Training Lyapunov (mult_squared, λ_reg=0.01)...
Epoch 10: test=0.010 λ=1.659
Epoch 20: test=0.010 λ=1.585
|
