============================================================ SCALED REGULARIZATION GRID SEARCH - DEPTH 4 Job ID: 15427300 | Node: gpub003 Start: Tue Jan 6 21:27:43 CST 2026 ============================================================ Grid: λ_reg=[0.0005, 0.001, 0.002, 0.005] × reg_type=[mult_linear, mult_log] Total: 8 experiments ============================================================ NVIDIA A40, 46068 MiB ============================================================ ====================================================================== SCALED REGULARIZATION GRID SEARCH ====================================================================== Depth: 4 Epochs: 100 Device: cuda GPU: NVIDIA A40 ====================================================================== Grid: 4 λ_reg × 2 reg_types = 8 experiments λ_reg values: [0.0005, 0.001, 0.002, 0.005] reg_types: ['mult_linear', 'mult_log'] Loading CIFAR-100... Train: 50000, Test: 10000 ============================================================ Config: depth=4, reg_type=mult_linear, λ_reg=0.0005 ============================================================ Training Vanilla... Epoch 10: test=0.504 Epoch 20: test=0.554 Epoch 30: test=0.582 Epoch 40: test=0.604 Epoch 50: test=0.607 Epoch 60: test=0.614 Epoch 70: test=0.618 Epoch 80: test=0.620 Epoch 90: test=0.622 Epoch 100: test=0.619 Training Lyapunov (mult_linear, λ_reg=0.0005)... Epoch 10: test=0.491 λ=1.881 Epoch 20: test=0.561 λ=1.843 Epoch 30: test=0.587 λ=1.837 Epoch 40: test=0.596 λ=1.835 Epoch 50: test=0.604 λ=1.831 Epoch 60: test=0.613 λ=1.842 Epoch 70: test=0.619 λ=1.842 Epoch 80: test=0.625 λ=1.851 Epoch 90: test=0.626 λ=1.853 Epoch 100: test=0.626 λ=1.855 Result: Vanilla=0.622, Lyap=0.626, Δ=+0.004 ============================================================ Config: depth=4, reg_type=mult_log, λ_reg=0.0005 ============================================================ Training Vanilla... Epoch 10: test=0.502 Epoch 20: test=0.558 Epoch 30: test=0.584 Epoch 40: test=0.592 Epoch 50: test=0.605 Epoch 60: test=0.611 Epoch 70: test=0.614 Epoch 80: test=0.618 Epoch 90: test=0.622 Epoch 100: test=0.627 Training Lyapunov (mult_log, λ_reg=0.0005)... Epoch 10: test=0.492 λ=1.898 Epoch 20: test=0.555 λ=1.862 Epoch 30: test=0.582 λ=1.859 Epoch 40: test=0.596 λ=1.856 Epoch 50: test=0.610 λ=1.860 Epoch 60: test=0.615 λ=1.863 Epoch 70: test=0.618 λ=1.866 Epoch 80: test=0.624 λ=1.871 Epoch 90: test=0.623 λ=1.872 Epoch 100: test=0.626 λ=1.873 Result: Vanilla=0.627, Lyap=0.626, Δ=-0.002 ============================================================ Config: depth=4, reg_type=mult_linear, λ_reg=0.001 ============================================================ Training Vanilla... Epoch 10: test=0.486 Epoch 20: test=0.568 Epoch 30: test=0.588 Epoch 40: test=0.592 Epoch 50: test=0.604 Epoch 60: test=0.614 Epoch 70: test=0.620 Epoch 80: test=0.619 Epoch 90: test=0.625 Epoch 100: test=0.623 Training Lyapunov (mult_linear, λ_reg=0.001)... Epoch 10: test=0.495 λ=1.894 Epoch 20: test=0.562 λ=1.857 Epoch 30: test=0.585 λ=1.854 Epoch 40: test=0.591 λ=1.848 Epoch 50: test=0.604 λ=1.851 Epoch 60: test=0.613 λ=1.852 Epoch 70: test=0.623 λ=1.864 Epoch 80: test=0.624 λ=1.866 Epoch 90: test=0.620 λ=1.863 Epoch 100: test=0.627 λ=1.868 Result: Vanilla=0.625, Lyap=0.627, Δ=+0.002 ============================================================ Config: depth=4, reg_type=mult_log, λ_reg=0.001 ============================================================ Training Vanilla... Epoch 10: test=0.500 Epoch 20: test=0.563 Epoch 30: test=0.587 Epoch 40: test=0.596 Epoch 50: test=0.603 Epoch 60: test=0.613 Epoch 70: test=0.616 Epoch 80: test=0.622 Epoch 90: test=0.623 Epoch 100: test=0.623 Training Lyapunov (mult_log, λ_reg=0.001)... Epoch 10: test=0.509 λ=1.885 Epoch 20: test=0.555 λ=1.847 Epoch 30: test=0.582 λ=1.835 Epoch 40: test=0.595 λ=1.831 Epoch 50: test=0.612 λ=1.836 Epoch 60: test=0.619 λ=1.840 Epoch 70: test=0.626 λ=1.840 Epoch 80: test=0.625 λ=1.843 Epoch 90: test=0.629 λ=1.849 Epoch 100: test=0.627 λ=1.850 Result: Vanilla=0.623, Lyap=0.629, Δ=+0.007 ============================================================ Config: depth=4, reg_type=mult_linear, λ_reg=0.002 ============================================================ Training Vanilla... Epoch 10: test=0.492 Epoch 20: test=0.563 Epoch 30: test=0.568 Epoch 40: test=0.594 Epoch 50: test=0.601 Epoch 60: test=0.613 Epoch 70: test=0.618 Epoch 80: test=0.620 Epoch 90: test=0.623 Epoch 100: test=0.624 Training Lyapunov (mult_linear, λ_reg=0.002)... Epoch 10: test=0.495 λ=1.891 Epoch 20: test=0.546 λ=1.854 Epoch 30: test=0.577 λ=1.844 Epoch 40: test=0.591 λ=1.836 Epoch 50: test=0.603 λ=1.849 Epoch 60: test=0.605 λ=1.848 Epoch 70: test=0.609 λ=1.851 Epoch 80: test=0.623 λ=1.856 Epoch 90: test=0.619 λ=1.858 Epoch 100: test=0.619 λ=1.857 Result: Vanilla=0.624, Lyap=0.623, Δ=-0.001 ============================================================ Config: depth=4, reg_type=mult_log, λ_reg=0.002 ============================================================ Training Vanilla... Epoch 10: test=0.489 Epoch 20: test=0.557 Epoch 30: test=0.585 Epoch 40: test=0.581 Epoch 50: test=0.613 Epoch 60: test=0.607 Epoch 70: test=0.619 Epoch 80: test=0.622 Epoch 90: test=0.625 Epoch 100: test=0.626 Training Lyapunov (mult_log, λ_reg=0.002)... Epoch 10: test=0.494 λ=1.890 Epoch 20: test=0.559 λ=1.843 Epoch 30: test=0.586 λ=1.831 Epoch 40: test=0.603 λ=1.826 Epoch 50: test=0.608 λ=1.829 Epoch 60: test=0.615 λ=1.844 Epoch 70: test=0.619 λ=1.853 Epoch 80: test=0.623 λ=1.856 Epoch 90: test=0.623 λ=1.853 Epoch 100: test=0.626 λ=1.852 Result: Vanilla=0.626, Lyap=0.626, Δ=-0.001 ============================================================ Config: depth=4, reg_type=mult_linear, λ_reg=0.005 ============================================================ Training Vanilla... Epoch 10: test=0.491 Epoch 20: test=0.558 Epoch 30: test=0.583 Epoch 40: test=0.600 Epoch 50: test=0.600 Epoch 60: test=0.609 Epoch 70: test=0.613 Epoch 80: test=0.615 Epoch 90: test=0.621 Epoch 100: test=0.623 Training Lyapunov (mult_linear, λ_reg=0.005)... Epoch 10: test=0.504 λ=1.864 Epoch 20: test=0.547 λ=1.848 Epoch 30: test=0.588 λ=1.839 Epoch 40: test=0.597 λ=1.830 Epoch 50: test=0.604 λ=1.833 Epoch 60: test=0.610 λ=1.840 Epoch 70: test=0.617 λ=1.850 Epoch 80: test=0.618 λ=1.852 Epoch 90: test=0.623 λ=1.857 Epoch 100: test=0.625 λ=1.851 Result: Vanilla=0.623, Lyap=0.625, Δ=+0.002 ============================================================ Config: depth=4, reg_type=mult_log, λ_reg=0.005 ============================================================ Training Vanilla... Epoch 10: test=0.485 Epoch 20: test=0.550 Epoch 30: test=0.576 Epoch 40: test=0.586 Epoch 50: test=0.598 Epoch 60: test=0.611 Epoch 70: test=0.613 Epoch 80: test=0.618 Epoch 90: test=0.621 Epoch 100: test=0.619 Training Lyapunov (mult_log, λ_reg=0.005)... Epoch 10: test=0.497 λ=1.872 Epoch 20: test=0.556 λ=1.833 Epoch 30: test=0.586 λ=1.826 Epoch 40: test=0.598 λ=1.825 Epoch 50: test=0.610 λ=1.835 Epoch 60: test=0.619 λ=1.838 Epoch 70: test=0.625 λ=1.847 Epoch 80: test=0.626 λ=1.850 Epoch 90: test=0.628 λ=1.852 Epoch 100: test=0.628 λ=1.851 Result: Vanilla=0.621, Lyap=0.628, Δ=+0.007 ====================================================================== SUMMARY: DEPTH = 4 ====================================================================== reg_type λ_reg Vanilla Lyapunov Δ Final λ ---------------------------------------------------------------------- mult_linear 0.00 0.622 0.626 +0.004 1.855 mult_log 0.00 0.627 0.626 -0.002 1.873 mult_linear 0.00 0.625 0.627 +0.002 1.868 mult_log 0.00 0.623 0.629 +0.007 1.850 mult_linear 0.00 0.624 0.623 -0.001 1.857 mult_log 0.00 0.626 0.626 -0.001 1.852 mult_linear 0.01 0.623 0.625 +0.002 1.851 mult_log 0.01 0.621 0.628 +0.007 1.851 ---------------------------------------------------------------------- BEST: mult_log, λ_reg=0.001 → 0.629 (Δ=+0.007) Results saved to: ./runs/scaled_grid/depth4_results.json ====================================================================== GRID SEARCH COMPLETE ====================================================================== ============================================================ Finished: Wed Jan 7 09:04:04 CST 2026 ============================================================