1
2
3
4
5
6
7
8
9
|
2025-12-25 21:55:51,030 - INFO - Loaded dataset: math-500
2025-12-25 21:55:51,242 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
2025-12-25 21:55:51,243 - INFO - Running method: vanilla
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:05<00:15, 5.28s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:10<00:10, 5.08s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:15<00:05, 5.24s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:16<00:00, 3.50s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:16<00:00, 4.12s/it]
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 20%|██ | 1/5 [00:04<00:18, 4.75s/it]
Loading checkpoint shards: 40%|████ | 2/5 [00:09<00:13, 4.55s/it]
Loading checkpoint shards: 60%|██████ | 3/5 [00:13<00:09, 4.55s/it]
Loading checkpoint shards: 80%|████████ | 4/5 [00:17<00:04, 4.26s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:19<00:00, 3.38s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:19<00:00, 3.87s/it]
2025-12-25 21:56:39,760 - INFO - Profile 1/5
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:06<00:18, 6.03s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:12<00:12, 6.01s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:17<00:05, 5.80s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:19<00:00, 4.43s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:19<00:00, 4.98s/it]
[2025-12-25T21:58:59.259] error: *** JOB 14357110 ON gpua016 CANCELLED AT 2025-12-25T21:58:59 DUE to SIGNAL Terminated ***
|