diff options
Diffstat (limited to 'runs/slurm_logs/15427300_scaled_grid_d4.out')
| -rw-r--r-- | runs/slurm_logs/15427300_scaled_grid_d4.out | 266 |
1 files changed, 266 insertions, 0 deletions
diff --git a/runs/slurm_logs/15427300_scaled_grid_d4.out b/runs/slurm_logs/15427300_scaled_grid_d4.out new file mode 100644 index 0000000..a8ca1d9 --- /dev/null +++ b/runs/slurm_logs/15427300_scaled_grid_d4.out @@ -0,0 +1,266 @@ +============================================================ +SCALED REGULARIZATION GRID SEARCH - DEPTH 4 +Job ID: 15427300 | Node: gpub003 +Start: Tue Jan 6 21:27:43 CST 2026 +============================================================ +Grid: λ_reg=[0.0005, 0.001, 0.002, 0.005] × reg_type=[mult_linear, mult_log] +Total: 8 experiments +============================================================ +NVIDIA A40, 46068 MiB +============================================================ +====================================================================== +SCALED REGULARIZATION GRID SEARCH +====================================================================== +Depth: 4 +Epochs: 100 +Device: cuda +GPU: NVIDIA A40 +====================================================================== + +Grid: 4 λ_reg × 2 reg_types = 8 experiments +λ_reg values: [0.0005, 0.001, 0.002, 0.005] +reg_types: ['mult_linear', 'mult_log'] + +Loading CIFAR-100... +Train: 50000, Test: 10000 + +============================================================ +Config: depth=4, reg_type=mult_linear, λ_reg=0.0005 +============================================================ + Training Vanilla... + Epoch 10: test=0.504 + Epoch 20: test=0.554 + Epoch 30: test=0.582 + Epoch 40: test=0.604 + Epoch 50: test=0.607 + Epoch 60: test=0.614 + Epoch 70: test=0.618 + Epoch 80: test=0.620 + Epoch 90: test=0.622 + Epoch 100: test=0.619 + Training Lyapunov (mult_linear, λ_reg=0.0005)... + Epoch 10: test=0.491 λ=1.881 + Epoch 20: test=0.561 λ=1.843 + Epoch 30: test=0.587 λ=1.837 + Epoch 40: test=0.596 λ=1.835 + Epoch 50: test=0.604 λ=1.831 + Epoch 60: test=0.613 λ=1.842 + Epoch 70: test=0.619 λ=1.842 + Epoch 80: test=0.625 λ=1.851 + Epoch 90: test=0.626 λ=1.853 + Epoch 100: test=0.626 λ=1.855 + Result: Vanilla=0.622, Lyap=0.626, Δ=+0.004 + +============================================================ +Config: depth=4, reg_type=mult_log, λ_reg=0.0005 +============================================================ + Training Vanilla... + Epoch 10: test=0.502 + Epoch 20: test=0.558 + Epoch 30: test=0.584 + Epoch 40: test=0.592 + Epoch 50: test=0.605 + Epoch 60: test=0.611 + Epoch 70: test=0.614 + Epoch 80: test=0.618 + Epoch 90: test=0.622 + Epoch 100: test=0.627 + Training Lyapunov (mult_log, λ_reg=0.0005)... + Epoch 10: test=0.492 λ=1.898 + Epoch 20: test=0.555 λ=1.862 + Epoch 30: test=0.582 λ=1.859 + Epoch 40: test=0.596 λ=1.856 + Epoch 50: test=0.610 λ=1.860 + Epoch 60: test=0.615 λ=1.863 + Epoch 70: test=0.618 λ=1.866 + Epoch 80: test=0.624 λ=1.871 + Epoch 90: test=0.623 λ=1.872 + Epoch 100: test=0.626 λ=1.873 + Result: Vanilla=0.627, Lyap=0.626, Δ=-0.002 + +============================================================ +Config: depth=4, reg_type=mult_linear, λ_reg=0.001 +============================================================ + Training Vanilla... + Epoch 10: test=0.486 + Epoch 20: test=0.568 + Epoch 30: test=0.588 + Epoch 40: test=0.592 + Epoch 50: test=0.604 + Epoch 60: test=0.614 + Epoch 70: test=0.620 + Epoch 80: test=0.619 + Epoch 90: test=0.625 + Epoch 100: test=0.623 + Training Lyapunov (mult_linear, λ_reg=0.001)... + Epoch 10: test=0.495 λ=1.894 + Epoch 20: test=0.562 λ=1.857 + Epoch 30: test=0.585 λ=1.854 + Epoch 40: test=0.591 λ=1.848 + Epoch 50: test=0.604 λ=1.851 + Epoch 60: test=0.613 λ=1.852 + Epoch 70: test=0.623 λ=1.864 + Epoch 80: test=0.624 λ=1.866 + Epoch 90: test=0.620 λ=1.863 + Epoch 100: test=0.627 λ=1.868 + Result: Vanilla=0.625, Lyap=0.627, Δ=+0.002 + +============================================================ +Config: depth=4, reg_type=mult_log, λ_reg=0.001 +============================================================ + Training Vanilla... + Epoch 10: test=0.500 + Epoch 20: test=0.563 + Epoch 30: test=0.587 + Epoch 40: test=0.596 + Epoch 50: test=0.603 + Epoch 60: test=0.613 + Epoch 70: test=0.616 + Epoch 80: test=0.622 + Epoch 90: test=0.623 + Epoch 100: test=0.623 + Training Lyapunov (mult_log, λ_reg=0.001)... + Epoch 10: test=0.509 λ=1.885 + Epoch 20: test=0.555 λ=1.847 + Epoch 30: test=0.582 λ=1.835 + Epoch 40: test=0.595 λ=1.831 + Epoch 50: test=0.612 λ=1.836 + Epoch 60: test=0.619 λ=1.840 + Epoch 70: test=0.626 λ=1.840 + Epoch 80: test=0.625 λ=1.843 + Epoch 90: test=0.629 λ=1.849 + Epoch 100: test=0.627 λ=1.850 + Result: Vanilla=0.623, Lyap=0.629, Δ=+0.007 + +============================================================ +Config: depth=4, reg_type=mult_linear, λ_reg=0.002 +============================================================ + Training Vanilla... + Epoch 10: test=0.492 + Epoch 20: test=0.563 + Epoch 30: test=0.568 + Epoch 40: test=0.594 + Epoch 50: test=0.601 + Epoch 60: test=0.613 + Epoch 70: test=0.618 + Epoch 80: test=0.620 + Epoch 90: test=0.623 + Epoch 100: test=0.624 + Training Lyapunov (mult_linear, λ_reg=0.002)... + Epoch 10: test=0.495 λ=1.891 + Epoch 20: test=0.546 λ=1.854 + Epoch 30: test=0.577 λ=1.844 + Epoch 40: test=0.591 λ=1.836 + Epoch 50: test=0.603 λ=1.849 + Epoch 60: test=0.605 λ=1.848 + Epoch 70: test=0.609 λ=1.851 + Epoch 80: test=0.623 λ=1.856 + Epoch 90: test=0.619 λ=1.858 + Epoch 100: test=0.619 λ=1.857 + Result: Vanilla=0.624, Lyap=0.623, Δ=-0.001 + +============================================================ +Config: depth=4, reg_type=mult_log, λ_reg=0.002 +============================================================ + Training Vanilla... + Epoch 10: test=0.489 + Epoch 20: test=0.557 + Epoch 30: test=0.585 + Epoch 40: test=0.581 + Epoch 50: test=0.613 + Epoch 60: test=0.607 + Epoch 70: test=0.619 + Epoch 80: test=0.622 + Epoch 90: test=0.625 + Epoch 100: test=0.626 + Training Lyapunov (mult_log, λ_reg=0.002)... + Epoch 10: test=0.494 λ=1.890 + Epoch 20: test=0.559 λ=1.843 + Epoch 30: test=0.586 λ=1.831 + Epoch 40: test=0.603 λ=1.826 + Epoch 50: test=0.608 λ=1.829 + Epoch 60: test=0.615 λ=1.844 + Epoch 70: test=0.619 λ=1.853 + Epoch 80: test=0.623 λ=1.856 + Epoch 90: test=0.623 λ=1.853 + Epoch 100: test=0.626 λ=1.852 + Result: Vanilla=0.626, Lyap=0.626, Δ=-0.001 + +============================================================ +Config: depth=4, reg_type=mult_linear, λ_reg=0.005 +============================================================ + Training Vanilla... + Epoch 10: test=0.491 + Epoch 20: test=0.558 + Epoch 30: test=0.583 + Epoch 40: test=0.600 + Epoch 50: test=0.600 + Epoch 60: test=0.609 + Epoch 70: test=0.613 + Epoch 80: test=0.615 + Epoch 90: test=0.621 + Epoch 100: test=0.623 + Training Lyapunov (mult_linear, λ_reg=0.005)... + Epoch 10: test=0.504 λ=1.864 + Epoch 20: test=0.547 λ=1.848 + Epoch 30: test=0.588 λ=1.839 + Epoch 40: test=0.597 λ=1.830 + Epoch 50: test=0.604 λ=1.833 + Epoch 60: test=0.610 λ=1.840 + Epoch 70: test=0.617 λ=1.850 + Epoch 80: test=0.618 λ=1.852 + Epoch 90: test=0.623 λ=1.857 + Epoch 100: test=0.625 λ=1.851 + Result: Vanilla=0.623, Lyap=0.625, Δ=+0.002 + +============================================================ +Config: depth=4, reg_type=mult_log, λ_reg=0.005 +============================================================ + Training Vanilla... + Epoch 10: test=0.485 + Epoch 20: test=0.550 + Epoch 30: test=0.576 + Epoch 40: test=0.586 + Epoch 50: test=0.598 + Epoch 60: test=0.611 + Epoch 70: test=0.613 + Epoch 80: test=0.618 + Epoch 90: test=0.621 + Epoch 100: test=0.619 + Training Lyapunov (mult_log, λ_reg=0.005)... + Epoch 10: test=0.497 λ=1.872 + Epoch 20: test=0.556 λ=1.833 + Epoch 30: test=0.586 λ=1.826 + Epoch 40: test=0.598 λ=1.825 + Epoch 50: test=0.610 λ=1.835 + Epoch 60: test=0.619 λ=1.838 + Epoch 70: test=0.625 λ=1.847 + Epoch 80: test=0.626 λ=1.850 + Epoch 90: test=0.628 λ=1.852 + Epoch 100: test=0.628 λ=1.851 + Result: Vanilla=0.621, Lyap=0.628, Δ=+0.007 + +====================================================================== +SUMMARY: DEPTH = 4 +====================================================================== +reg_type λ_reg Vanilla Lyapunov Δ Final λ +---------------------------------------------------------------------- +mult_linear 0.00 0.622 0.626 +0.004 1.855 +mult_log 0.00 0.627 0.626 -0.002 1.873 +mult_linear 0.00 0.625 0.627 +0.002 1.868 +mult_log 0.00 0.623 0.629 +0.007 1.850 +mult_linear 0.00 0.624 0.623 -0.001 1.857 +mult_log 0.00 0.626 0.626 -0.001 1.852 +mult_linear 0.01 0.623 0.625 +0.002 1.851 +mult_log 0.01 0.621 0.628 +0.007 1.851 +---------------------------------------------------------------------- +BEST: mult_log, λ_reg=0.001 → 0.629 (Δ=+0.007) + +Results saved to: ./runs/scaled_grid/depth4_results.json + +====================================================================== +GRID SEARCH COMPLETE +====================================================================== +============================================================ +Finished: Wed Jan 7 09:04:04 CST 2026 +============================================================ |