============================================================ SCALED REGULARIZATION GRID SEARCH - DEPTH 4 Job ID: 15345523 | Node: gpub081 Start: Mon Jan 5 05:47:15 CST 2026 ============================================================ Grid: λ_reg=[0.01, 0.05, 0.1, 0.3] × reg_type=[mult_linear, mult_squared, mult_log] Total: 12 experiments ============================================================ NVIDIA A40, 46068 MiB ============================================================ ====================================================================== SCALED REGULARIZATION GRID SEARCH ====================================================================== Depth: 4 Epochs: 100 Device: cuda GPU: NVIDIA A40 ====================================================================== Grid: 4 λ_reg × 3 reg_types = 12 experiments λ_reg values: [0.01, 0.05, 0.1, 0.3] reg_types: ['mult_linear', 'mult_squared', 'mult_log'] Loading CIFAR-100... Train: 50000, Test: 10000 ============================================================ Config: depth=4, reg_type=mult_linear, λ_reg=0.01 ============================================================ Training Vanilla... Epoch 10: test=0.482 Epoch 20: test=0.553 Epoch 30: test=0.584 Epoch 40: test=0.597 Epoch 50: test=0.603 Epoch 60: test=0.611 Epoch 70: test=0.611 Epoch 80: test=0.616 Epoch 90: test=0.621 Epoch 100: test=0.620 Training Lyapunov (mult_linear, λ_reg=0.01)... Epoch 10: test=0.462 λ=1.872 Epoch 20: test=0.537 λ=1.833 Epoch 30: test=0.568 λ=1.815 Epoch 40: test=0.580 λ=1.802 Epoch 50: test=0.568 λ=1.793 Epoch 60: test=0.586 λ=1.794 Epoch 70: test=0.592 λ=1.794 Epoch 80: test=0.592 λ=1.793 Epoch 90: test=0.595 λ=1.796 Epoch 100: test=0.589 λ=1.795 Result: Vanilla=0.621, Lyap=0.595, Δ=-0.026 ============================================================ Config: depth=4, reg_type=mult_squared, λ_reg=0.01 ============================================================ Training Vanilla... Epoch 10: test=0.512 Epoch 20: test=0.552 Epoch 30: test=0.579 Epoch 40: test=0.586 Epoch 50: test=0.596 Epoch 60: test=0.609 Epoch 70: test=0.610 Epoch 80: test=0.616 Epoch 90: test=0.618 Epoch 100: test=0.617 Training Lyapunov (mult_squared, λ_reg=0.01)... Epoch 10: test=0.101 λ=1.471 Epoch 20: test=0.057 λ=1.450 Epoch 30: test=0.036 λ=1.447 Epoch 40: test=0.017 λ=1.448 Epoch 50: test=0.033 λ=1.454 Epoch 60: test=0.044 λ=1.457 Epoch 70: test=0.038 λ=1.457 Epoch 80: test=0.035 λ=1.454 Epoch 90: test=0.044 λ=1.457 Epoch 100: test=0.035 λ=1.456 Result: Vanilla=0.618, Lyap=0.101, Δ=-0.517 ============================================================ Config: depth=4, reg_type=mult_log, λ_reg=0.01 ============================================================ Training Vanilla... Epoch 10: test=0.483 Epoch 20: test=0.548 Epoch 30: test=0.578 Epoch 40: test=0.597 Epoch 50: test=0.600 Epoch 60: test=0.609 Epoch 70: test=0.614 Epoch 80: test=0.610 Epoch 90: test=0.617 Epoch 100: test=0.618 Training Lyapunov (mult_log, λ_reg=0.01)... Epoch 10: test=0.481 λ=1.889 Epoch 20: test=0.543 λ=1.852 Epoch 30: test=0.577 λ=1.841 Epoch 40: test=0.586 λ=1.841 Epoch 50: test=0.595 λ=1.842 Epoch 60: test=0.607 λ=1.846 Epoch 70: test=0.612 λ=1.854 Epoch 80: test=0.614 λ=1.855