diff options
Diffstat (limited to 'results/fa_core_experiments.log')
| -rw-r--r-- | results/fa_core_experiments.log | 220 |
1 files changed, 220 insertions, 0 deletions
diff --git a/results/fa_core_experiments.log b/results/fa_core_experiments.log new file mode 100644 index 0000000..45e92c2 --- /dev/null +++ b/results/fa_core_experiments.log @@ -0,0 +1,220 @@ +========================================== +FA CORE EXPERIMENTS (A-H) +========================================== +Start: Wed Apr 22 09:42:02 PM CDT 2026 + +=== A: FA main audit (100ep, 3 seeds) === +Using device: cuda:0 + +============================================================ +Seed 42 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0491, train=0.2436, test=0.2789 + [FA] Epoch 10: loss=1.8849, train=0.3172, test=0.3416 + [FA] Epoch 20: loss=1.8524, train=0.3333, test=0.3609 + [FA] Epoch 30: loss=1.8295, train=0.3444, test=0.3714 + [FA] Epoch 40: loss=1.8168, train=0.3508, test=0.3823 + [FA] Epoch 50: loss=1.8001, train=0.3588, test=0.3842 + [FA] Epoch 60: loss=1.7960, train=0.3575, test=0.3806 + [FA] Epoch 70: loss=1.7859, train=0.3609, test=0.3892 + [FA] Epoch 80: loss=1.7819, train=0.3658, test=0.3919 + [FA] Epoch 90: loss=1.7770, train=0.3677, test=0.3913 + [FA] Epoch 100: loss=1.7776, train=0.3685, test=0.3929 + Final test acc: 0.3929 + +============================================================ +Seed 123 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0394, train=0.2504, test=0.2905 + [FA] Epoch 10: loss=1.8597, train=0.3285, test=0.3514 + [FA] Epoch 20: loss=1.8128, train=0.3518, test=0.3801 + [FA] Epoch 30: loss=1.7718, train=0.3646, test=0.3944 + [FA] Epoch 40: loss=1.7571, train=0.3705, test=0.3937 + [FA] Epoch 50: loss=1.7417, train=0.3765, test=0.4046 + [FA] Epoch 60: loss=1.7407, train=0.3791, test=0.4087 + [FA] Epoch 70: loss=1.7346, train=0.3839, test=0.4048 + [FA] Epoch 80: loss=1.7344, train=0.3828, test=0.4070 + [FA] Epoch 90: loss=1.7341, train=0.3838, test=0.4093 + [FA] Epoch 100: loss=1.7313, train=0.3814, test=0.4099 + Final test acc: 0.4099 + +============================================================ +Seed 456 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0641, train=0.2401, test=0.2713 + [FA] Epoch 10: loss=1.8796, train=0.3171, test=0.3422 + [FA] Epoch 20: loss=1.8405, train=0.3365, test=0.3666 + [FA] Epoch 30: loss=1.8124, train=0.3511, test=0.3808 + [FA] Epoch 40: loss=1.7906, train=0.3597, test=0.3872 + [FA] Epoch 50: loss=1.7753, train=0.3662, test=0.3900 + [FA] Epoch 60: loss=1.7704, train=0.3685, test=0.3957 + [FA] Epoch 70: loss=1.7610, train=0.3737, test=0.3968 + [FA] Epoch 80: loss=1.7538, train=0.3723, test=0.3999 + [FA] Epoch 90: loss=1.7540, train=0.3762, test=0.3992 + [FA] Epoch 100: loss=1.7500, train=0.3750, test=0.3996 + Final test acc: 0.3996 + +All results saved to results/fa_main_audit/results_cifar10.json + +=== B: FA+penalty lam=1e-2 (30ep, 3 seeds) === +Using device: cuda:0 + +============================================================ +Seed 42 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0011, train=0.2748, test=0.3237 + [FA] Epoch 10: loss=1.9015, train=0.3259, test=0.3462 + [FA] Epoch 20: loss=1.8762, train=0.3376, test=0.3620 + [FA] Epoch 30: loss=1.8683, train=0.3472, test=0.3713 + Final test acc: 0.3713 + +============================================================ +Seed 123 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=1.9927, train=0.2807, test=0.3339 + [FA] Epoch 10: loss=1.9047, train=0.3250, test=0.3513 + [FA] Epoch 20: loss=1.8867, train=0.3368, test=0.3600 + [FA] Epoch 30: loss=1.8784, train=0.3428, test=0.3660 + Final test acc: 0.3660 + +============================================================ +Seed 456 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0075, train=0.2735, test=0.3312 + [FA] Epoch 10: loss=1.9005, train=0.3261, test=0.3561 + [FA] Epoch 20: loss=1.8808, train=0.3402, test=0.3682 + [FA] Epoch 30: loss=1.8698, train=0.3499, test=0.3695 + Final test acc: 0.3695 + +All results saved to results/fa_penalty_30ep/results_cifar10.json + +=== C: FA no-pen 30ep (3 seeds) === +Using device: cuda:0 + +============================================================ +Seed 42 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0491, train=0.2436, test=0.2789 + [FA] Epoch 10: loss=1.8842, train=0.3176, test=0.3427 + [FA] Epoch 20: loss=1.8545, train=0.3324, test=0.3630 + [FA] Epoch 30: loss=1.8426, train=0.3414, test=0.3655 + Final test acc: 0.3655 + +============================================================ +Seed 123 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0394, train=0.2504, test=0.2905 + [FA] Epoch 10: loss=1.8601, train=0.3275, test=0.3514 + [FA] Epoch 20: loss=1.8234, train=0.3491, test=0.3753 + [FA] Epoch 30: loss=1.8114, train=0.3527, test=0.3793 + Final test acc: 0.3793 + +============================================================ +Seed 456 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0641, train=0.2401, test=0.2713 + [FA] Epoch 10: loss=1.8808, train=0.3167, test=0.3426 + [FA] Epoch 20: loss=1.8417, train=0.3367, test=0.3677 + [FA] Epoch 30: loss=1.8354, train=0.3412, test=0.3699 + Final test acc: 0.3699 + +All results saved to results/fa_no_penalty_30ep/results_cifar10.json + +=== D: SKIPPED (frozen blocks needs separate script) === + +=== E: No-terminal-LN FA (100ep, 3 seeds) === +usage: snapshot_evolution_no_outln.py [-h] [--output_dir OUTPUT_DIR] + [--epochs EPOCHS] [--lr LR] [--wd WD] + [--seed SEED] [--depth DEPTH] + [--d_hidden D_HIDDEN] +snapshot_evolution_no_outln.py: error: unrecognized arguments: --method fa + [E] seed 42: snapshot_evolution_no_outln.py may not support FA yet — skipping +usage: snapshot_evolution_no_outln.py [-h] [--output_dir OUTPUT_DIR] + [--epochs EPOCHS] [--lr LR] [--wd WD] + [--seed SEED] [--depth DEPTH] + [--d_hidden D_HIDDEN] +snapshot_evolution_no_outln.py: error: unrecognized arguments: --method fa + [E] seed 123: snapshot_evolution_no_outln.py may not support FA yet — skipping +usage: snapshot_evolution_no_outln.py [-h] [--output_dir OUTPUT_DIR] + [--epochs EPOCHS] [--lr LR] [--wd WD] + [--seed SEED] [--depth DEPTH] + [--d_hidden D_HIDDEN] +snapshot_evolution_no_outln.py: error: unrecognized arguments: --method fa + [E] seed 456: snapshot_evolution_no_outln.py may not support FA yet — skipping + +=== F: Random-target FA (100ep, s42) === +Using device: cuda:0 + +============================================================ +Seed 42 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.3211, train=0.0992, test=0.0948 + [FA] Epoch 10: loss=2.3113, train=0.1016, test=0.0894 + [FA] Epoch 20: loss=2.3071, train=0.1004, test=0.1045 + [FA] Epoch 30: loss=2.3050, train=0.0974, test=0.1226 + [FA] Epoch 40: loss=2.3039, train=0.1005, test=0.0837 + [FA] Epoch 50: loss=2.3034, train=0.1006, test=0.0945 + [FA] Epoch 60: loss=2.3032, train=0.0982, test=0.1195 + [FA] Epoch 70: loss=2.3029, train=0.0994, test=0.1104 + [FA] Epoch 80: loss=2.3027, train=0.1005, test=0.0927 + [FA] Epoch 90: loss=2.3026, train=0.1001, test=0.1170 + [FA] Epoch 100: loss=2.3026, train=0.0988, test=0.1200 + Final test acc: 0.1200 + +All results saved to results/fa_random_targets_s42/results_cifar10.json + +=== G: FA early checkpoints (5ep, 3 seeds) === +Using device: cuda:0 + +============================================================ +Seed 42 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0491, train=0.2436, test=0.2789 + Final test acc: 0.3219 + +============================================================ +Seed 123 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0394, train=0.2504, test=0.2905 + Final test acc: 0.3478 + +============================================================ +Seed 456 +============================================================ + +--- FA --- + [FA] Epoch 1: loss=2.0641, train=0.2401, test=0.2713 + Final test acc: 0.3242 + +All results saved to results/fa_early_ckpts/results_cifar10.json + +=== H: FA trajectory — covered by A (log has per-epoch values) === + +========================================== +ALL CORE FA EXPERIMENTS DONE +End: Wed Apr 22 10:21:51 PM CDT 2026 +========================================== |