| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 36 hours | SOTA attempt (val_bpb=1.2064) (#49) | spokane-way | |
| * SOTA attempt * Improve score on SXM --------- Co-authored-by: spokane-way <spokane@way> | |||
| 36 hours | fp16 tied embedding + lr/warmdown tuning — val_bpb 1.2197 (#42) | Renier Velazco | |
| keep tok_emb.weight in fp16 during int8 export (kills the quant gap), shrink MLP hidden to 992 to fit under 16MB, bump warmdown to 3600 and matrix LR to 0.06. tested on 8xH100 SXM (2 seeds) and 8xH200 SXM (3 seeds). Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> | |||
| 3 days | Launch snapshot | Will DePue | |
 |
index : parameter-golf.git | |
| Unnamed repository; edit this file 'description' to name the repository. | Ubuntu |
| summaryrefslogtreecommitdiff |