1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
|
============================================================
SCALED REGULARIZATION GRID SEARCH - DEPTH 4
Job ID: 15345523 | Node: gpub081
Start: Mon Jan 5 05:47:15 CST 2026
============================================================
Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_squared, mult_log]
Total: 12 experiments
============================================================
NVIDIA A40, 46068 MiB
============================================================
======================================================================
SCALED REGULARIZATION GRID SEARCH
======================================================================
Depth: 4
Epochs: 100
Device: cuda
GPU: NVIDIA A40
======================================================================
Grid: 4 λ_reg × 3 reg_types = 12 experiments
λ_reg values: [0.01, 0.05, 0.1, 0.3]
reg_types: ['mult_linear', 'mult_squared', 'mult_log']
Loading CIFAR-100...
Train: 50000, Test: 10000
============================================================
Config: depth=4, reg_type=mult_linear, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.482
Epoch 20: test=0.553
Epoch 30: test=0.584
Epoch 40: test=0.597
Epoch 50: test=0.603
Epoch 60: test=0.611
Epoch 70: test=0.611
Epoch 80: test=0.616
Epoch 90: test=0.621
Epoch 100: test=0.620
Training Lyapunov (mult_linear, λ_reg=0.01)...
Epoch 10: test=0.462 λ=1.872
Epoch 20: test=0.537 λ=1.833
Epoch 30: test=0.568 λ=1.815
Epoch 40: test=0.580 λ=1.802
Epoch 50: test=0.568 λ=1.793
Epoch 60: test=0.586 λ=1.794
Epoch 70: test=0.592 λ=1.794
Epoch 80: test=0.592 λ=1.793
Epoch 90: test=0.595 λ=1.796
Epoch 100: test=0.589 λ=1.795
Result: Vanilla=0.621, Lyap=0.595, Δ=-0.026
============================================================
Config: depth=4, reg_type=mult_squared, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.512
Epoch 20: test=0.552
Epoch 30: test=0.579
Epoch 40: test=0.586
Epoch 50: test=0.596
Epoch 60: test=0.609
Epoch 70: test=0.610
Epoch 80: test=0.616
Epoch 90: test=0.618
Epoch 100: test=0.617
Training Lyapunov (mult_squared, λ_reg=0.01)...
Epoch 10: test=0.101 λ=1.471
Epoch 20: test=0.057 λ=1.450
Epoch 30: test=0.036 λ=1.447
Epoch 40: test=0.017 λ=1.448
Epoch 50: test=0.033 λ=1.454
Epoch 60: test=0.044 λ=1.457
Epoch 70: test=0.038 λ=1.457
Epoch 80: test=0.035 λ=1.454
Epoch 90: test=0.044 λ=1.457
Epoch 100: test=0.035 λ=1.456
Result: Vanilla=0.618, Lyap=0.101, Δ=-0.517
============================================================
Config: depth=4, reg_type=mult_log, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.483
Epoch 20: test=0.548
Epoch 30: test=0.578
Epoch 40: test=0.597
Epoch 50: test=0.600
Epoch 60: test=0.609
Epoch 70: test=0.614
Epoch 80: test=0.610
Epoch 90: test=0.617
Epoch 100: test=0.618
Training Lyapunov (mult_log, λ_reg=0.01)...
Epoch 10: test=0.481 λ=1.889
Epoch 20: test=0.543 λ=1.852
Epoch 30: test=0.577 λ=1.841
Epoch 40: test=0.586 λ=1.841
Epoch 50: test=0.595 λ=1.842
Epoch 60: test=0.607 λ=1.846
Epoch 70: test=0.612 λ=1.854
Epoch 80: test=0.614 λ=1.855
|
