1
2
3
4
5
6
7
8
9
10
11
12
|
2025-12-25 09:10:36,065 - INFO - Loaded dataset: math-500
2025-12-25 09:10:36,277 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
2025-12-25 09:10:36,278 - INFO - Running method: vanilla
2025-12-25 09:10:36,278 - INFO - Profile 1/20
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:06<00:19, 6.40s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:13<00:13, 6.74s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:20<00:06, 6.83s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:20<00:00, 4.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:20<00:00, 5.24s/it]
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 20%|██ | 1/5 [00:07<00:30, 7.52s/it]
Loading checkpoint shards: 40%|████ | 2/5 [00:13<00:19, 6.37s/it]
Loading checkpoint shards: 60%|██████ | 3/5 [00:19<00:13, 6.51s/it]
Loading checkpoint shards: 80%|████████ | 4/5 [00:24<00:05, 5.98s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:27<00:00, 4.71s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:27<00:00, 5.48s/it]
2025-12-25 09:11:36,637 - ERROR - Error in session: 'NoneType' object is not subscriptable
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.37s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:06<00:06, 3.27s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:10<00:03, 3.55s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:10<00:00, 2.21s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:10<00:00, 2.58s/it]
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 20%|██ | 1/5 [00:01<00:07, 1.95s/it]
Loading checkpoint shards: 40%|████ | 2/5 [00:05<00:09, 3.02s/it]
Loading checkpoint shards: 60%|██████ | 3/5 [00:09<00:06, 3.48s/it]
Loading checkpoint shards: 80%|████████ | 4/5 [00:13<00:03, 3.47s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:14<00:00, 2.81s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:14<00:00, 2.97s/it]
2025-12-25 09:12:05,675 - ERROR - Error in session: 'NoneType' object is not subscriptable
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:08, 2.75s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:06<00:06, 3.40s/it][2025-12-25T09:12:15.828] error: *** JOB 14355896 ON gpua036 CANCELLED AT 2025-12-25T09:12:15 DUE to SIGNAL Terminated ***
|
