diff options
| author | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-05 18:10:38 -0500 |
|---|---|---|
| committer | YurenHao0426 <Blackhao0426@gmail.com> | 2026-04-05 18:10:38 -0500 |
| commit | 107155532f2683198aac33c9bb3bd647d357a80a (patch) | |
| tree | fda9ad6512d744d9dca3ebb580497cd6535ff468 /data/longlamp.py | |
| parent | ab5fae5decb7d24aafd16d855885c1c99e51cf7f (diff) | |
Tune PromptTuning/PrefixTuning hyperparams: lr=1e-3/5e-4, steps=100
Previous lr=0.01 gave R-L=0.01 (broken output). Reduced to lr=1e-3 for
PromptTuning, lr=5e-4 for PrefixTuning, increased steps from 30 to 100.
Also made steps parameter configurable in _run_peft.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Diffstat (limited to 'data/longlamp.py')
0 files changed, 0 insertions, 0 deletions