============================================================ SCALED REGULARIZATION GRID SEARCH - DEPTH 8 Job ID: 15348085 | Node: gpub032 Start: Mon Jan 5 13:03:23 CST 2026 ============================================================ Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_log] Total: 8 experiments ============================================================ NVIDIA A40, 46068 MiB ============================================================ ====================================================================== SCALED REGULARIZATION GRID SEARCH ====================================================================== Depth: 8 Epochs: 100 Device: cuda GPU: NVIDIA A40 ====================================================================== Grid: 4 λ_reg × 2 reg_types = 8 experiments λ_reg values: [0.01, 0.05, 0.1, 0.3] reg_types: ['mult_linear', 'mult_log'] Loading CIFAR-100... Train: 50000, Test: 10000 ============================================================ Config: depth=8, reg_type=mult_linear, λ_reg=0.01 ============================================================ Training Vanilla... Epoch 10: test=0.426 Epoch 20: test=0.515 Epoch 30: test=0.547 Epoch 40: test=0.570 Epoch 50: test=0.585 Epoch 60: test=0.585 Epoch 70: test=0.593 Epoch 80: test=0.590 Epoch 90: test=0.598 Epoch 100: test=0.597 Training Lyapunov (mult_linear, λ_reg=0.01)... Epoch 10: test=0.010 λ=1.664 Epoch 20: test=0.010 λ=1.676 Epoch 30: test=0.010 λ=1.585 Epoch 40: test=0.010 λ=1.662 Epoch 50: test=0.010 λ=1.611 Epoch 60: test=0.010 λ=1.688 Epoch 70: test=0.010 λ=1.662 Epoch 80: test=0.010 λ=1.704 Epoch 90: test=0.010 λ=1.909 Epoch 100: test=0.010 λ=1.858 Result: Vanilla=0.598, Lyap=0.010, Δ=-0.588 ============================================================ Config: depth=8, reg_type=mult_log, λ_reg=0.01 ============================================================ Training Vanilla... Epoch 10: test=0.445 Epoch 20: test=0.521 Epoch 30: test=0.550 Epoch 40: test=0.560 Epoch 50: test=0.586 Epoch 60: test=0.590 Epoch 70: test=0.601 Epoch 80: test=0.605 Epoch 90: test=0.609 Epoch 100: test=0.609 Training Lyapunov (mult_log, λ_reg=0.01)... Epoch 10: test=0.010 λ=1.644 Epoch 20: test=0.010 λ=1.615 Epoch 30: test=0.010 λ=1.614 Epoch 40: test=0.012 λ=1.703 Epoch 50: test=0.010 λ=1.646 Epoch 60: test=0.008 λ=1.620 Epoch 70: test=0.011 λ=1.611 Epoch 80: test=0.010 λ=1.622 Epoch 90: test=0.012 λ=1.642 Epoch 100: test=0.011 λ=1.596 Result: Vanilla=0.609, Lyap=0.012, Δ=-0.597 ============================================================ Config: depth=8, reg_type=mult_linear, λ_reg=0.05 ============================================================ Training Vanilla... Epoch 10: test=0.420 Epoch 20: test=0.526 Epoch 30: test=0.565 Epoch 40: test=0.580 Epoch 50: test=0.589 Epoch 60: test=0.596 Epoch 70: test=0.600 Epoch 80: test=0.597 Epoch 90: test=0.600 Epoch 100: test=0.607 Training Lyapunov (mult_linear, λ_reg=0.05)... Epoch 10: test=0.010 λ=1.668 Epoch 20: test=0.010 λ=1.552 Epoch 30: test=0.010 λ=1.514 Epoch 40: test=0.010 λ=1.510 Epoch 50: test=0.010 λ=1.518 Epoch 60: test=0.010 λ=1.520 Epoch 70: test=0.010 λ=1.519 Epoch 80: test=0.010 λ=1.522 Epoch 90: test=0.010 λ=1.521 Epoch 100: test=0.010 λ=1.519 Result: Vanilla=0.607, Lyap=0.010, Δ=-0.597 ============================================================ Config: depth=8, reg_type=mult_log, λ_reg=0.05 ============================================================ Training Vanilla... Epoch 10: test=0.446 Epoch 20: test=0.522 Epoch 30: test=0.555 Epoch 40: test=0.565 Epoch 50: test=0.588 Epoch 60: test=0.590 Epoch 70: test=0.585 Epoch 80: test=0.596 Epoch 90: test=0.598 Epoch 100: test=0.603 Training Lyapunov (mult_log, λ_reg=0.05)... Epoch 10: test=0.010 λ=1.643 Epoch 20: test=0.010 λ=1.557 Epoch 30: test=0.010 λ=1.589 Epoch 40: test=0.010 λ=1.580 Epoch 50: test=0.010 λ=1.613 Epoch 60: test=0.010 λ=1.635 Epoch 70: test=0.010 λ=1.648 Epoch 80: test=0.010 λ=1.688 Epoch 90: test=0.010 λ=1.818 Epoch 100: test=0.010 λ=1.682 Result: Vanilla=0.603, Lyap=0.010, Δ=-0.593 ============================================================ Config: depth=8, reg_type=mult_linear, λ_reg=0.1 ============================================================ Training Vanilla... Epoch 10: test=0.436 Epoch 20: test=0.534 Epoch 30: test=0.547 Epoch 40: test=0.577 Epoch 50: test=0.598 Epoch 60: test=0.597 Epoch 70: test=0.604 Epoch 80: test=0.600 Epoch 90: test=0.608 Epoch 100: test=0.600 Training Lyapunov (mult_linear, λ_reg=0.1)... Epoch 10: test=0.010 λ=1.502 Epoch 20: test=0.010 λ=1.495 Epoch 30: test=0.010 λ=1.511 Epoch 40: test=0.010 λ=1.520 Epoch 50: test=0.010 λ=1.522 Epoch 60: test=0.010 λ=1.521 Epoch 70: test=0.010 λ=1.526 Epoch 80: test=0.010 λ=1.523 Epoch 90: test=0.010 λ=1.526 Epoch 100: test=0.010 λ=1.523 Result: Vanilla=0.608, Lyap=0.010, Δ=-0.598 ============================================================ Config: depth=8, reg_type=mult_log, λ_reg=0.1 ============================================================ Training Vanilla... Epoch 10: test=0.433 Epoch 20: test=0.523 Epoch 30: test=0.547 Epoch 40: test=0.577 Epoch 50: test=0.592 Epoch 60: test=0.593 Epoch 70: test=0.602 Epoch 80: test=0.605 Epoch 90: test=0.605 Epoch 100: test=0.606 Training Lyapunov (mult_log, λ_reg=0.1)... Epoch 10: test=0.010 λ=1.796