1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
|
============================================================
SCALED REGULARIZATION GRID SEARCH - DEPTH 8
Job ID: 15345524 | Node: gpub028
Start: Mon Jan 5 05:47:15 CST 2026
============================================================
Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_squared, mult_log]
Total: 12 experiments
============================================================
NVIDIA A40, 46068 MiB
============================================================
======================================================================
SCALED REGULARIZATION GRID SEARCH
======================================================================
Depth: 8
Epochs: 100
Device: cuda
GPU: NVIDIA A40
======================================================================
Grid: 4 λ_reg × 3 reg_types = 12 experiments
λ_reg values: [0.01, 0.05, 0.1, 0.3]
reg_types: ['mult_linear', 'mult_squared', 'mult_log']
Loading CIFAR-100...
Train: 50000, Test: 10000
============================================================
Config: depth=8, reg_type=mult_linear, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.451
Epoch 20: test=0.515
Epoch 30: test=0.570
Epoch 40: test=0.571
Epoch 50: test=0.591
Epoch 60: test=0.593
Epoch 70: test=0.596
Epoch 80: test=0.595
Epoch 90: test=0.597
Epoch 100: test=0.596
Training Lyapunov (mult_linear, λ_reg=0.01)...
Epoch 10: test=0.010 λ=1.581
Epoch 20: test=0.010 λ=1.591
Epoch 30: test=0.010 λ=1.601
Epoch 40: test=0.010 λ=1.673
Epoch 50: test=0.010 λ=1.592
Epoch 60: test=0.010 λ=1.564
Epoch 70: test=0.010 λ=1.616
Epoch 80: test=0.010 λ=1.569
Epoch 90: test=0.010 λ=1.596
Epoch 100: test=0.010 λ=1.610
Result: Vanilla=0.597, Lyap=0.010, Δ=-0.587
============================================================
Config: depth=8, reg_type=mult_squared, λ_reg=0.01
============================================================
Training Vanilla...
Epoch 10: test=0.428
Epoch 20: test=0.535
Epoch 30: test=0.558
Epoch 40: test=0.568
Epoch 50: test=0.588
Epoch 60: test=0.589
Epoch 70: test=0.589
Epoch 80: test=0.598
Epoch 90: test=0.602
Epoch 100: test=0.602
Training Lyapunov (mult_squared, λ_reg=0.01)...
Epoch 10: test=0.011 λ=1.586
Epoch 20: test=0.010 λ=1.615
Epoch 30: test=0.010 λ=1.536
Epoch 40: test=0.010 λ=1.568
Epoch 50: test=0.010 λ=1.652
Epoch 60: test=0.010 λ=1.672
Epoch 70: test=0.010 λ=1.727
Epoch 80: test=0.010 λ=1.645
Epoch 90: test=0.010 λ=1.600
|
