diff options
| author | Will DePue <williamd@openai.com> | 2026-03-19 14:07:09 -0700 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2026-03-19 14:07:09 -0700 |
| commit | ce6cf9ac8589991ac7c4140f6f9fc09b0ae3817a (patch) | |
| tree | 4c5a00c7ad1a3bd438840826db61b3a54c6d9a1d /README.md | |
| parent | 2d6e9e0e613de139f95dd6f191f91853bec13894 (diff) | |
Update README.md
Diffstat (limited to 'README.md')
| -rw-r--r-- | README.md | 4 |
1 files changed, 2 insertions, 2 deletions
@@ -30,8 +30,8 @@ Happy training! | Run | Score | Author | Summary | Date | Info | |-----|------:|--------|---------|------|------| -| Sliding Window Eval | 1.1925 | Matthew Li | Sliding window evaluation at stride=64, increasing context for eval | 2026-03-18 | [info](records/track_10min_16mb/2026-03-19_SlidingWindowEval/README.md) | -| 4k seq length| 1.2014 | Spokane Way | 4k seq length + better hypers | 2026-03-18 | [info](records/track_10min_16mb/2026-03-18_LongContextSeq2048/README.md) | +| Sliding Window Eval | 1.1925 | Matthew Li | Sliding window evaluation at stride=64, increasing context for eval | 2026-03-19 | [info](records/track_10min_16mb/2026-03-19_SlidingWindowEval/README.md) | +| 4k seq length| 1.2014 | Spokane Way | 4k seq length + better hypers | 2026-03-19 | [info](records/track_10min_16mb/2026-03-18_LongContextSeq2048/README.md) | | 2048 seq length | 1.206 | Spokane Way | 2048 seq length (train + val) | 2026-03-18 | [info](records/track_10min_16mb/2026-03-18_LongContextSeq2048/README.md) | | fp16 Embed | 1.2197 | Renier Velazco | FP16 Tied Embedding + LR/Warmdown Tuning | 2026-03-18 | [info](records/track_10min_16mb/2026-03-18_FP16Embed_WD3600/README.md) | | Naive Baseline | 1.2244 | Baseline | 9layer 512dim 1024vocab TiedEmbeddings 4 KV heads | 2026-03-18 | [info](records/track_10min_16mb/2026-03-17_NaiveBaseline/README.md) | |