From 9f170d4c818840e417c69d9148eb63eedd916861 Mon Sep 17 00:00:00 2001 From: Will DePue Date: Wed, 18 Mar 2026 16:32:14 -0700 Subject: Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to 'README.md') diff --git a/README.md b/README.md index de856a3..4fdb3e6 100644 --- a/README.md +++ b/README.md @@ -144,7 +144,7 @@ There's no perfectly clear answer here and it's hard to draw a clean line around **What are the restrictions on evaluation?** -We won't accept submissions that take more than 10 minutes on 8xH100 to evaluate, but otherwise you're free to evaluate however. As with modded-nanogpt, we allow evaluation at any sequence length. And, obviously, you aren't allowed to access any training data during evaluation, unless you pay for those bits in the <16MB limit. We encourage competitors to push the bounds of evaluation methods as aggressively as with training methods. +We won't accept submissions that take more than 10 minutes on 8xH100 to evaluate (Note: This limit is in addition to the 10 minutes of training time allowed!), but otherwise you're free to evaluate however. As with modded-nanogpt, we allow evaluation at any sequence length. And, obviously, you aren't allowed to access any training data during evaluation, unless you pay for those bits in the <16MB limit. We encourage competitors to push the bounds of evaluation methods as aggressively as with training methods. ## Submission Process -- cgit v1.2.3