summaryrefslogtreecommitdiff
path: root/collaborativeagents/slurm/logs/run_multiturn_14357110.err
blob: 53553f111979ec396e363cdd373f8986652dc419 (plain)
1
2
3
4
5
6
7
8
9
2025-12-25 21:55:51,030 - INFO - Loaded dataset: math-500
2025-12-25 21:55:51,242 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
2025-12-25 21:55:51,243 - INFO - Running method: vanilla
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:05<00:15,  5.28s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:10<00:10,  5.08s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:15<00:05,  5.24s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:16<00:00,  3.50s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:16<00:00,  4.12s/it]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  20%|██        | 1/5 [00:04<00:18,  4.75s/it]
Loading checkpoint shards:  40%|████      | 2/5 [00:09<00:13,  4.55s/it]
Loading checkpoint shards:  60%|██████    | 3/5 [00:13<00:09,  4.55s/it]
Loading checkpoint shards:  80%|████████  | 4/5 [00:17<00:04,  4.26s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:19<00:00,  3.38s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:19<00:00,  3.87s/it]
2025-12-25 21:56:39,760 - INFO -   Profile 1/5

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:06<00:18,  6.03s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:12<00:12,  6.01s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:17<00:05,  5.80s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:19<00:00,  4.43s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:19<00:00,  4.98s/it]
[2025-12-25T21:58:59.259] error: *** JOB 14357110 ON gpua016 CANCELLED AT 2025-12-25T21:58:59 DUE to SIGNAL Terminated ***