========================================== FA CORE EXPERIMENTS (A-H) ========================================== Start: Wed Apr 22 09:42:02 PM CDT 2026 === A: FA main audit (100ep, 3 seeds) === Using device: cuda:0 ============================================================ Seed 42 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0491, train=0.2436, test=0.2789 [FA] Epoch 10: loss=1.8849, train=0.3172, test=0.3416 [FA] Epoch 20: loss=1.8524, train=0.3333, test=0.3609 [FA] Epoch 30: loss=1.8295, train=0.3444, test=0.3714 [FA] Epoch 40: loss=1.8168, train=0.3508, test=0.3823 [FA] Epoch 50: loss=1.8001, train=0.3588, test=0.3842 [FA] Epoch 60: loss=1.7960, train=0.3575, test=0.3806 [FA] Epoch 70: loss=1.7859, train=0.3609, test=0.3892 [FA] Epoch 80: loss=1.7819, train=0.3658, test=0.3919 [FA] Epoch 90: loss=1.7770, train=0.3677, test=0.3913 [FA] Epoch 100: loss=1.7776, train=0.3685, test=0.3929 Final test acc: 0.3929 ============================================================ Seed 123 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0394, train=0.2504, test=0.2905 [FA] Epoch 10: loss=1.8597, train=0.3285, test=0.3514 [FA] Epoch 20: loss=1.8128, train=0.3518, test=0.3801 [FA] Epoch 30: loss=1.7718, train=0.3646, test=0.3944 [FA] Epoch 40: loss=1.7571, train=0.3705, test=0.3937 [FA] Epoch 50: loss=1.7417, train=0.3765, test=0.4046 [FA] Epoch 60: loss=1.7407, train=0.3791, test=0.4087 [FA] Epoch 70: loss=1.7346, train=0.3839, test=0.4048 [FA] Epoch 80: loss=1.7344, train=0.3828, test=0.4070 [FA] Epoch 90: loss=1.7341, train=0.3838, test=0.4093 [FA] Epoch 100: loss=1.7313, train=0.3814, test=0.4099 Final test acc: 0.4099 ============================================================ Seed 456 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0641, train=0.2401, test=0.2713 [FA] Epoch 10: loss=1.8796, train=0.3171, test=0.3422 [FA] Epoch 20: loss=1.8405, train=0.3365, test=0.3666 [FA] Epoch 30: loss=1.8124, train=0.3511, test=0.3808 [FA] Epoch 40: loss=1.7906, train=0.3597, test=0.3872 [FA] Epoch 50: loss=1.7753, train=0.3662, test=0.3900 [FA] Epoch 60: loss=1.7704, train=0.3685, test=0.3957 [FA] Epoch 70: loss=1.7610, train=0.3737, test=0.3968 [FA] Epoch 80: loss=1.7538, train=0.3723, test=0.3999 [FA] Epoch 90: loss=1.7540, train=0.3762, test=0.3992 [FA] Epoch 100: loss=1.7500, train=0.3750, test=0.3996 Final test acc: 0.3996 All results saved to results/fa_main_audit/results_cifar10.json === B: FA+penalty lam=1e-2 (30ep, 3 seeds) === Using device: cuda:0 ============================================================ Seed 42 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0011, train=0.2748, test=0.3237 [FA] Epoch 10: loss=1.9015, train=0.3259, test=0.3462 [FA] Epoch 20: loss=1.8762, train=0.3376, test=0.3620 [FA] Epoch 30: loss=1.8683, train=0.3472, test=0.3713 Final test acc: 0.3713 ============================================================ Seed 123 ============================================================ --- FA --- [FA] Epoch 1: loss=1.9927, train=0.2807, test=0.3339 [FA] Epoch 10: loss=1.9047, train=0.3250, test=0.3513 [FA] Epoch 20: loss=1.8867, train=0.3368, test=0.3600 [FA] Epoch 30: loss=1.8784, train=0.3428, test=0.3660 Final test acc: 0.3660 ============================================================ Seed 456 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0075, train=0.2735, test=0.3312 [FA] Epoch 10: loss=1.9005, train=0.3261, test=0.3561 [FA] Epoch 20: loss=1.8808, train=0.3402, test=0.3682 [FA] Epoch 30: loss=1.8698, train=0.3499, test=0.3695 Final test acc: 0.3695 All results saved to results/fa_penalty_30ep/results_cifar10.json === C: FA no-pen 30ep (3 seeds) === Using device: cuda:0 ============================================================ Seed 42 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0491, train=0.2436, test=0.2789 [FA] Epoch 10: loss=1.8842, train=0.3176, test=0.3427 [FA] Epoch 20: loss=1.8545, train=0.3324, test=0.3630 [FA] Epoch 30: loss=1.8426, train=0.3414, test=0.3655 Final test acc: 0.3655 ============================================================ Seed 123 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0394, train=0.2504, test=0.2905 [FA] Epoch 10: loss=1.8601, train=0.3275, test=0.3514 [FA] Epoch 20: loss=1.8234, train=0.3491, test=0.3753 [FA] Epoch 30: loss=1.8114, train=0.3527, test=0.3793 Final test acc: 0.3793 ============================================================ Seed 456 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0641, train=0.2401, test=0.2713 [FA] Epoch 10: loss=1.8808, train=0.3167, test=0.3426 [FA] Epoch 20: loss=1.8417, train=0.3367, test=0.3677 [FA] Epoch 30: loss=1.8354, train=0.3412, test=0.3699 Final test acc: 0.3699 All results saved to results/fa_no_penalty_30ep/results_cifar10.json === D: SKIPPED (frozen blocks needs separate script) === === E: No-terminal-LN FA (100ep, 3 seeds) === usage: snapshot_evolution_no_outln.py [-h] [--output_dir OUTPUT_DIR] [--epochs EPOCHS] [--lr LR] [--wd WD] [--seed SEED] [--depth DEPTH] [--d_hidden D_HIDDEN] snapshot_evolution_no_outln.py: error: unrecognized arguments: --method fa [E] seed 42: snapshot_evolution_no_outln.py may not support FA yet — skipping usage: snapshot_evolution_no_outln.py [-h] [--output_dir OUTPUT_DIR] [--epochs EPOCHS] [--lr LR] [--wd WD] [--seed SEED] [--depth DEPTH] [--d_hidden D_HIDDEN] snapshot_evolution_no_outln.py: error: unrecognized arguments: --method fa [E] seed 123: snapshot_evolution_no_outln.py may not support FA yet — skipping usage: snapshot_evolution_no_outln.py [-h] [--output_dir OUTPUT_DIR] [--epochs EPOCHS] [--lr LR] [--wd WD] [--seed SEED] [--depth DEPTH] [--d_hidden D_HIDDEN] snapshot_evolution_no_outln.py: error: unrecognized arguments: --method fa [E] seed 456: snapshot_evolution_no_outln.py may not support FA yet — skipping === F: Random-target FA (100ep, s42) === Using device: cuda:0 ============================================================ Seed 42 ============================================================ --- FA --- [FA] Epoch 1: loss=2.3211, train=0.0992, test=0.0948 [FA] Epoch 10: loss=2.3113, train=0.1016, test=0.0894 [FA] Epoch 20: loss=2.3071, train=0.1004, test=0.1045 [FA] Epoch 30: loss=2.3050, train=0.0974, test=0.1226 [FA] Epoch 40: loss=2.3039, train=0.1005, test=0.0837 [FA] Epoch 50: loss=2.3034, train=0.1006, test=0.0945 [FA] Epoch 60: loss=2.3032, train=0.0982, test=0.1195 [FA] Epoch 70: loss=2.3029, train=0.0994, test=0.1104 [FA] Epoch 80: loss=2.3027, train=0.1005, test=0.0927 [FA] Epoch 90: loss=2.3026, train=0.1001, test=0.1170 [FA] Epoch 100: loss=2.3026, train=0.0988, test=0.1200 Final test acc: 0.1200 All results saved to results/fa_random_targets_s42/results_cifar10.json === G: FA early checkpoints (5ep, 3 seeds) === Using device: cuda:0 ============================================================ Seed 42 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0491, train=0.2436, test=0.2789 Final test acc: 0.3219 ============================================================ Seed 123 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0394, train=0.2504, test=0.2905 Final test acc: 0.3478 ============================================================ Seed 456 ============================================================ --- FA --- [FA] Epoch 1: loss=2.0641, train=0.2401, test=0.2713 Final test acc: 0.3242 All results saved to results/fa_early_ckpts/results_cifar10.json === H: FA trajectory — covered by A (log has per-epoch values) === ========================================== ALL CORE FA EXPERIMENTS DONE End: Wed Apr 22 10:21:51 PM CDT 2026 ==========================================