1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
|
============================================================
EXTREME THRESHOLD 4.0 Experiment
Job ID: 15261460 | Node: gpub099
Start: Sat Jan 3 09:41:01 CST 2026
============================================================
NVIDIA A40, 46068 MiB
============================================================
================================================================================
DEPTH SCALING BENCHMARK
================================================================================
Dataset: cifar100
Depths: [4, 8, 12, 16]
Timesteps: 4
Epochs: 150
λ_reg: 0.3, λ_target: -0.1
Reg type: extreme, Warmup epochs: 10
Device: cuda
================================================================================
Loading cifar100...
Classes: 100, Input: (3, 32, 32)
Train: 50000, Test: 10000
Depth configurations: [(4, '4×1'), (8, '4×2'), (12, '4×3'), (16, '4×4')]
Regularization type: extreme
Warmup epochs: 10
Stable init: False
Lyapunov threshold: 4.0
============================================================
Depth = 4 conv layers (4 stages × 1 blocks)
============================================================
Vanilla: depth=4, params=1,756,836
Epoch 10: train=0.493 test=0.438 σ=9.40e-01/3.53e-08
Epoch 20: train=0.629 test=0.493 σ=5.78e-01/2.42e-08
Epoch 30: train=0.701 test=0.500 σ=4.69e-01/2.00e-08
Epoch 40: train=0.754 test=0.540 σ=4.17e-01/1.73e-08
Epoch 50: train=0.799 test=0.567 σ=3.66e-01/1.53e-08
Epoch 60: train=0.830 test=0.587 σ=3.42e-01/1.40e-08
Epoch 70: train=0.858 test=0.583 σ=3.21e-01/1.29e-08
Epoch 80: train=0.881 test=0.577 σ=2.97e-01/1.20e-08
Epoch 90: train=0.903 test=0.597 σ=2.85e-01/1.13e-08
Epoch 100: train=0.920 test=0.599 σ=2.61e-01/1.03e-08
Epoch 110: train=0.931 test=0.608 σ=2.64e-01/9.94e-09
Epoch 120: train=0.941 test=0.602 σ=2.38e-01/9.00e-09
Epoch 130: train=0.947 test=0.609 σ=2.41e-01/8.84e-09
Epoch 140: train=0.949 test=0.613 σ=2.32e-01/8.45e-09
Epoch 150: train=0.951 test=0.607 σ=2.44e-01/8.91e-09
Best test acc: 0.613
Lyapunov: depth=4, params=1,756,836
Epoch 10: train=0.492 test=0.420 λ=2.049 σ=9.51e-01/3.58e-08
Epoch 20: train=0.625 test=0.500 λ=1.999 σ=5.91e-01/2.46e-08
Epoch 30: train=0.701 test=0.533 λ=1.975 σ=4.87e-01/2.04e-08
Epoch 40: train=0.754 test=0.547 λ=1.964 σ=4.27e-01/1.73e-08
Epoch 50: train=0.797 test=0.563 λ=1.957 σ=3.73e-01/1.54e-08
Epoch 60: train=0.833 test=0.569 λ=1.964 σ=3.30e-01/1.38e-08
Epoch 70: train=0.859 test=0.571 λ=1.968 σ=3.28e-01/1.31e-08
Epoch 80: train=0.884 test=0.600 λ=1.961 σ=3.04e-01/1.20e-08
Epoch 90: train=0.903 test=0.587 λ=1.967 σ=2.87e-01/1.11e-08
Epoch 100: train=0.919 test=0.594 λ=1.964 σ=2.72e-01/1.04e-08
Epoch 110: train=0.933 test=0.602 λ=1.966 σ=2.57e-01/9.82e-09
Epoch 120: train=0.942 test=0.596 λ=1.972 σ=2.45e-01/9.57e-09
Epoch 130: train=0.949 test=0.602 λ=1.971 σ=2.35e-01/8.64e-09
Epoch 140: train=0.949 test=0.606 λ=1.975 σ=2.39e-01/8.83e-09
Epoch 150: train=0.951 test=0.603 λ=1.972 σ=2.33e-01/8.59e-09
Best test acc: 0.609
============================================================
Depth = 8 conv layers (4 stages × 2 blocks)
============================================================
Vanilla: depth=8, params=4,892,196
Epoch 10: train=0.394 test=0.359 σ=8.68e-01/3.12e-08
Epoch 20: train=0.541 test=0.435 σ=4.85e-01/2.20e-08
Epoch 30: train=0.635 test=0.468 σ=3.82e-01/1.77e-08
Epoch 40: train=0.698 test=0.479 σ=3.30e-01/1.56e-08
Epoch 50: train=0.752 test=0.496 σ=3.12e-01/1.41e-08
Epoch 60: train=0.798 test=0.511 σ=2.87e-01/1.26e-08
Epoch 70: train=0.838 test=0.513 σ=2.71e-01/1.15e-08
Epoch 80: train=0.869 test=0.519 σ=2.50e-01/1.06e-08
Epoch 90: train=0.897 test=0.527 σ=2.39e-01/9.71e-09
Epoch 100: train=0.919 test=0.515 σ=2.26e-01/9.04e-09
Epoch 110: train=0.934 test=0.518 σ=2.08e-01/8.20e-09
Epoch 120: train=0.944 test=0.525 σ=2.15e-01/8.02e-09
Epoch 130: train=0.951 test=0.529 σ=2.06e-01/7.60e-09
Epoch 140: train=0.955 test=0.536 σ=1.94e-01/7.42e-09
Epoch 150: train=0.957 test=0.521 σ=2.00e-01/7.50e-09
Best test acc: 0.539
Lyapunov: depth=8, params=4,892,196
Epoch 10: train=0.395 test=0.363 λ=2.893 σ=7.82e-01/3.03e-08
Epoch 20: train=0.547 test=0.425 λ=2.878 σ=4.66e-01/2.14e-08
Epoch 30: train=0.632 test=0.481 λ=2.864 σ=3.80e-01/1.77e-08
|
