diff options
Diffstat (limited to 'results/dfa_residual_penalty/run_lam1e-2_s42.log')
| -rw-r--r-- | results/dfa_residual_penalty/run_lam1e-2_s42.log | 21 |
1 files changed, 21 insertions, 0 deletions
diff --git a/results/dfa_residual_penalty/run_lam1e-2_s42.log b/results/dfa_residual_penalty/run_lam1e-2_s42.log new file mode 100644 index 0000000..28de526 --- /dev/null +++ b/results/dfa_residual_penalty/run_lam1e-2_s42.log @@ -0,0 +1,21 @@ +DFA + residual-branch penalty test: seed=42, lam=0.01 + ep 0: ||h_L||=8.893e+00 ||g_2||=9.934e-04 acc=0.1152 + ep 1: ||h_L||=7.888e+02 ||g_2||=1.141e-05 eval_acc=0.3359 test_acc=0.3353 + ep 10: ||h_L||=7.782e+03 ||g_2||=2.211e-06 eval_acc=0.3633 test_acc=0.3482 + ep 20: ||h_L||=1.515e+04 ||g_2||=1.526e-06 eval_acc=0.3750 test_acc=0.3571 + ep 30: ||h_L||=2.156e+04 ||g_2||=1.278e-06 eval_acc=0.3564 test_acc=0.3549 + ep 40: ||h_L||=2.685e+04 ||g_2||=1.155e-06 eval_acc=0.3721 test_acc=0.3550 + ep 50: ||h_L||=3.100e+04 ||g_2||=1.077e-06 eval_acc=0.3682 test_acc=0.3545 + ep 60: ||h_L||=3.408e+04 ||g_2||=1.043e-06 eval_acc=0.3623 test_acc=0.3579 + ep 70: ||h_L||=3.606e+04 ||g_2||=1.014e-06 eval_acc=0.3740 test_acc=0.3652 + ep 80: ||h_L||=3.715e+04 ||g_2||=9.945e-07 eval_acc=0.3711 test_acc=0.3606 + ep 90: ||h_L||=3.757e+04 ||g_2||=9.877e-07 eval_acc=0.3682 test_acc=0.3609 + ep 100: ||h_L||=3.764e+04 ||g_2||=9.873e-07 eval_acc=0.3721 test_acc=0.3625 + +FINAL test acc: 0.3625 +Compare to: + DFA-vanilla (3-seed mean): 0.308 + DFA-shallow (3-seed mean): 0.349 + DFA-frozen (3-seed mean): 0.349 + BP-trainable (3-seed mean): 0.609 +Saved results/dfa_residual_penalty/dfa_pen_lam0.01_s42.json |