1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
|
============================================================
SCALED REGULARIZATION GRID SEARCH - DEPTH 12
Job ID: 15348086 | Node: gpub017
Start: Mon Jan 5 13:08:27 CST 2026
============================================================
Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_log]
Total: 8 experiments
============================================================
NVIDIA A40, 46068 MiB
============================================================
======================================================================
SCALED REGULARIZATION GRID SEARCH
======================================================================
Depth: 12
Epochs: 100
Device: cuda
GPU: NVIDIA A40
======================================================================
Grid: 4 λ_reg × 2 reg_types = 8 experiments
λ_reg values: [0.01, 0.05, 0.1, 0.3]
reg_types: ['mult_linear', 'mult_log']
Loading CIFAR-100...
Train: 50000, Test: 10000
============================================================
Config: depth=12, reg_type=mult_linear, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.228
Epoch 20: test=0.358
Epoch 30: test=0.429
Epoch 40: test=0.445
Epoch 50: test=0.421
Epoch 60: test=0.447
Epoch 70: test=0.463
Epoch 80: test=0.456
Epoch 90: test=0.466
Epoch 100: test=0.462
Training Lyapunov (mult_linear, λ_reg=0.01)...
Epoch 10: test=0.010 λ=1.696
Epoch 20: test=0.010 λ=1.740
Epoch 30: test=0.010 λ=1.622
Epoch 40: test=0.010 λ=1.614
Epoch 50: test=0.010 λ=1.609
Epoch 60: test=0.010 λ=1.606
Epoch 70: test=0.010 λ=1.620
Epoch 80: test=0.010 λ=1.625
Epoch 90: test=0.010 λ=1.630
Epoch 100: test=0.010 λ=1.636
Result: Vanilla=0.466, Lyap=0.010, Δ=-0.456
============================================================
Config: depth=12, reg_type=mult_log, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.210
Epoch 20: test=0.290
Epoch 30: test=0.370
Epoch 40: test=0.441
Epoch 50: test=0.464
Epoch 60: test=0.448
Epoch 70: test=0.458
Epoch 80: test=0.469
Epoch 90: test=0.473
Epoch 100: test=0.482
Training Lyapunov (mult_log, λ_reg=0.01)...
Epoch 10: test=0.013 λ=1.679
Epoch 20: test=0.010 λ=1.636
Epoch 30: test=0.010 λ=1.613
Epoch 40: test=0.012 λ=1.598
Epoch 50: test=0.010 λ=1.628
Epoch 60: test=0.011 λ=1.620
Epoch 70: test=0.010 λ=1.604
Epoch 80: test=0.010 λ=1.585
Epoch 90: test=0.010 λ=1.588
Epoch 100: test=0.010 λ=1.578
Result: Vanilla=0.482, Lyap=0.013, Δ=-0.470
============================================================
Config: depth=12, reg_type=mult_linear, λ_reg=0.05
============================================================
Training Vanilla...
Epoch 10: test=0.260
Epoch 20: test=0.325
Epoch 30: test=0.377
Epoch 40: test=0.406
Epoch 50: test=0.455
Epoch 60: test=0.457
Epoch 70: test=0.485
Epoch 80: test=0.467
Epoch 90: test=0.466
Epoch 100: test=0.467
Training Lyapunov (mult_linear, λ_reg=0.05)...
Epoch 10: test=0.010 λ=1.630
Epoch 20: test=0.010 λ=1.633
Epoch 30: test=0.010 λ=1.637
Epoch 40: test=0.010 λ=1.650
Epoch 50: test=0.010 λ=1.615
Epoch 60: test=0.010 λ=1.601
Epoch 70: test=0.010 λ=1.596
Epoch 80: test=0.010 λ=1.589
Epoch 90: test=0.010 λ=1.582
Epoch 100: test=0.010 λ=1.588
Result: Vanilla=0.485, Lyap=0.010, Δ=-0.475
============================================================
Config: depth=12, reg_type=mult_log, λ_reg=0.05
============================================================
Training Vanilla...
Epoch 10: test=0.236
Epoch 20: test=0.344
Epoch 30: test=0.414
Epoch 40: test=0.462
Epoch 50: test=0.457
Epoch 60: test=0.461
Epoch 70: test=0.483
Epoch 80: test=0.488
Epoch 90: test=0.498
Epoch 100: test=0.496
Training Lyapunov (mult_log, λ_reg=0.05)...
Epoch 10: test=0.010 λ=1.625
Epoch 20: test=0.012 λ=1.626
Epoch 30: test=0.010 λ=1.597
Epoch 40: test=0.010 λ=1.627
Epoch 50: test=0.010 λ=1.589
Epoch 60: test=0.010 λ=1.572
Epoch 70: test=0.010 λ=1.569
Epoch 80: test=0.010 λ=1.560
Epoch 90: test=0.010 λ=1.563
Epoch 100: test=0.010 λ=1.561
Result: Vanilla=0.498, Lyap=0.012, Δ=-0.486
============================================================
Config: depth=12, reg_type=mult_linear, λ_reg=0.1
============================================================
Training Vanilla...
Epoch 10: test=0.180
Epoch 20: test=0.291
Epoch 30: test=0.316
Epoch 40: test=0.406
Epoch 50: test=0.452
Epoch 60: test=0.446
Epoch 70: test=0.464
Epoch 80: test=0.472
Epoch 90: test=0.455
Epoch 100: test=0.468
Training Lyapunov (mult_linear, λ_reg=0.1)...
Epoch 10: test=0.018 λ=1.644
Epoch 20: test=0.010 λ=1.600
|
