1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
|
============================================================
SCALED REGULARIZATION GRID SEARCH - DEPTH 8
Job ID: 15348085 | Node: gpub032
Start: Mon Jan 5 13:03:23 CST 2026
============================================================
Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_log]
Total: 8 experiments
============================================================
NVIDIA A40, 46068 MiB
============================================================
======================================================================
SCALED REGULARIZATION GRID SEARCH
======================================================================
Depth: 8
Epochs: 100
Device: cuda
GPU: NVIDIA A40
======================================================================
Grid: 4 λ_reg × 2 reg_types = 8 experiments
λ_reg values: [0.01, 0.05, 0.1, 0.3]
reg_types: ['mult_linear', 'mult_log']
Loading CIFAR-100...
Train: 50000, Test: 10000
============================================================
Config: depth=8, reg_type=mult_linear, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.426
Epoch 20: test=0.515
Epoch 30: test=0.547
Epoch 40: test=0.570
Epoch 50: test=0.585
Epoch 60: test=0.585
Epoch 70: test=0.593
Epoch 80: test=0.590
Epoch 90: test=0.598
Epoch 100: test=0.597
Training Lyapunov (mult_linear, λ_reg=0.01)...
Epoch 10: test=0.010 λ=1.664
Epoch 20: test=0.010 λ=1.676
Epoch 30: test=0.010 λ=1.585
Epoch 40: test=0.010 λ=1.662
Epoch 50: test=0.010 λ=1.611
Epoch 60: test=0.010 λ=1.688
Epoch 70: test=0.010 λ=1.662
Epoch 80: test=0.010 λ=1.704
Epoch 90: test=0.010 λ=1.909
Epoch 100: test=0.010 λ=1.858
Result: Vanilla=0.598, Lyap=0.010, Δ=-0.588
============================================================
Config: depth=8, reg_type=mult_log, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.445
Epoch 20: test=0.521
Epoch 30: test=0.550
Epoch 40: test=0.560
Epoch 50: test=0.586
Epoch 60: test=0.590
Epoch 70: test=0.601
Epoch 80: test=0.605
Epoch 90: test=0.609
Epoch 100: test=0.609
Training Lyapunov (mult_log, λ_reg=0.01)...
Epoch 10: test=0.010 λ=1.644
Epoch 20: test=0.010 λ=1.615
Epoch 30: test=0.010 λ=1.614
Epoch 40: test=0.012 λ=1.703
Epoch 50: test=0.010 λ=1.646
Epoch 60: test=0.008 λ=1.620
Epoch 70: test=0.011 λ=1.611
Epoch 80: test=0.010 λ=1.622
Epoch 90: test=0.012 λ=1.642
Epoch 100: test=0.011 λ=1.596
Result: Vanilla=0.609, Lyap=0.012, Δ=-0.597
============================================================
Config: depth=8, reg_type=mult_linear, λ_reg=0.05
============================================================
Training Vanilla...
Epoch 10: test=0.420
Epoch 20: test=0.526
Epoch 30: test=0.565
Epoch 40: test=0.580
Epoch 50: test=0.589
Epoch 60: test=0.596
Epoch 70: test=0.600
Epoch 80: test=0.597
Epoch 90: test=0.600
Epoch 100: test=0.607
Training Lyapunov (mult_linear, λ_reg=0.05)...
Epoch 10: test=0.010 λ=1.668
Epoch 20: test=0.010 λ=1.552
Epoch 30: test=0.010 λ=1.514
Epoch 40: test=0.010 λ=1.510
Epoch 50: test=0.010 λ=1.518
Epoch 60: test=0.010 λ=1.520
Epoch 70: test=0.010 λ=1.519
Epoch 80: test=0.010 λ=1.522
Epoch 90: test=0.010 λ=1.521
Epoch 100: test=0.010 λ=1.519
Result: Vanilla=0.607, Lyap=0.010, Δ=-0.597
============================================================
Config: depth=8, reg_type=mult_log, λ_reg=0.05
============================================================
Training Vanilla...
Epoch 10: test=0.446
Epoch 20: test=0.522
Epoch 30: test=0.555
Epoch 40: test=0.565
Epoch 50: test=0.588
Epoch 60: test=0.590
Epoch 70: test=0.585
Epoch 80: test=0.596
Epoch 90: test=0.598
Epoch 100: test=0.603
Training Lyapunov (mult_log, λ_reg=0.05)...
Epoch 10: test=0.010 λ=1.643
Epoch 20: test=0.010 λ=1.557
Epoch 30: test=0.010 λ=1.589
Epoch 40: test=0.010 λ=1.580
Epoch 50: test=0.010 λ=1.613
Epoch 60: test=0.010 λ=1.635
Epoch 70: test=0.010 λ=1.648
Epoch 80: test=0.010 λ=1.688
Epoch 90: test=0.010 λ=1.818
Epoch 100: test=0.010 λ=1.682
Result: Vanilla=0.603, Lyap=0.010, Δ=-0.593
============================================================
Config: depth=8, reg_type=mult_linear, λ_reg=0.1
============================================================
Training Vanilla...
Epoch 10: test=0.436
Epoch 20: test=0.534
Epoch 30: test=0.547
Epoch 40: test=0.577
Epoch 50: test=0.598
Epoch 60: test=0.597
Epoch 70: test=0.604
Epoch 80: test=0.600
Epoch 90: test=0.608
Epoch 100: test=0.600
Training Lyapunov (mult_linear, λ_reg=0.1)...
Epoch 10: test=0.010 λ=1.502
Epoch 20: test=0.010 λ=1.495
Epoch 30: test=0.010 λ=1.511
Epoch 40: test=0.010 λ=1.520
Epoch 50: test=0.010 λ=1.522
Epoch 60: test=0.010 λ=1.521
Epoch 70: test=0.010 λ=1.526
Epoch 80: test=0.010 λ=1.523
Epoch 90: test=0.010 λ=1.526
Epoch 100: test=0.010 λ=1.523
Result: Vanilla=0.608, Lyap=0.010, Δ=-0.598
============================================================
Config: depth=8, reg_type=mult_log, λ_reg=0.1
============================================================
Training Vanilla...
Epoch 10: test=0.433
Epoch 20: test=0.523
Epoch 30: test=0.547
Epoch 40: test=0.577
Epoch 50: test=0.592
Epoch 60: test=0.593
Epoch 70: test=0.602
Epoch 80: test=0.605
Epoch 90: test=0.605
Epoch 100: test=0.606
Training Lyapunov (mult_log, λ_reg=0.1)...
Epoch 10: test=0.010 λ=1.796
|
