2025-12-25 10:52:43,142 - INFO - Loaded dataset: math-500
2025-12-25 10:52:43,385 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
2025-12-25 10:52:43,386 - INFO - Running method: contextual
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:06<00:19,  6.47s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:12<00:12,  6.43s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:18<00:06,  6.24s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:20<00:00,  4.59s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:20<00:00,  5.24s/it]
2025-12-25 10:53:08,251 - INFO -   Profile 1/20
2025-12-25 10:54:31,245 - INFO -   Profile 2/20
2025-12-25 10:55:49,021 - INFO -   Profile 3/20
2025-12-25 10:57:07,721 - INFO -   Profile 4/20
2025-12-25 10:57:46,873 - INFO -   Profile 5/20
2025-12-25 10:58:26,077 - INFO -   Profile 6/20
2025-12-25 10:59:05,298 - INFO -   Profile 7/20
2025-12-25 10:59:44,507 - INFO -   Profile 8/20
2025-12-25 11:00:23,700 - INFO -   Profile 9/20
2025-12-25 11:01:02,919 - INFO -   Profile 10/20
2025-12-25 11:01:42,131 - INFO -   Profile 11/20
2025-12-25 11:02:57,684 - INFO -   Profile 12/20
2025-12-25 11:03:56,775 - INFO -   Profile 13/20
2025-12-25 11:05:03,753 - INFO -   Profile 14/20
2025-12-25 11:05:51,697 - INFO -   Profile 15/20
2025-12-25 11:06:52,101 - INFO -   Profile 16/20
2025-12-25 11:07:27,746 - INFO -   Profile 17/20
2025-12-25 11:08:54,497 - INFO -   Profile 18/20
2025-12-25 11:10:40,288 - INFO -   Profile 19/20
2025-12-25 11:12:07,984 - INFO -   Profile 20/20
2025-12-25 11:12:44,173 - INFO - Running method: reflection

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:06<00:18,  6.00s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:13<00:13,  6.60s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:20<00:06,  6.78s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00,  4.87s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00,  5.49s/it]
2025-12-25 11:13:06,758 - INFO -   Profile 1/20
2025-12-25 11:14:12,362 - INFO -   Profile 2/20
2025-12-25 11:15:35,445 - INFO -   Profile 3/20
2025-12-25 11:16:54,467 - INFO -   Profile 4/20
2025-12-25 11:18:12,199 - INFO -   Profile 5/20
2025-12-25 11:19:42,312 - INFO -   Profile 6/20
2025-12-25 11:21:06,922 - INFO -   Profile 7/20
2025-12-25 11:22:54,996 - INFO -   Profile 8/20
2025-12-25 11:24:08,753 - INFO -   Profile 9/20
2025-12-25 11:25:19,792 - INFO -   Profile 10/20
2025-12-25 11:26:42,922 - INFO -   Profile 11/20
2025-12-25 11:28:16,287 - INFO -   Profile 12/20
2025-12-25 11:29:37,361 - INFO -   Profile 13/20
2025-12-25 11:30:51,174 - INFO -   Profile 14/20
2025-12-25 11:32:25,617 - INFO -   Profile 15/20
2025-12-25 11:33:26,202 - INFO -   Profile 16/20
2025-12-25 11:34:28,137 - INFO -   Profile 17/20
2025-12-25 11:35:45,693 - INFO -   Profile 18/20
2025-12-25 11:37:00,624 - INFO -   Profile 19/20
2025-12-25 11:38:12,427 - INFO -   Profile 20/20
2025-12-25 11:39:29,675 - INFO - Running method: reflection_grpo

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:06<00:18,  6.18s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:13<00:13,  6.71s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:19<00:06,  6.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00,  4.71s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00,  5.35s/it]
2025-12-25 11:39:51,748 - INFO -   Profile 1/20
2025-12-25 11:41:06,412 - INFO -   Profile 2/20
2025-12-25 11:42:24,983 - INFO -   Profile 3/20
2025-12-25 11:43:42,715 - INFO -   Profile 4/20
2025-12-25 11:45:21,420 - INFO -   Profile 5/20
2025-12-25 11:46:41,875 - INFO -   Profile 6/20
2025-12-25 11:48:09,967 - INFO -   Profile 7/20
2025-12-25 11:49:25,792 - INFO -   Profile 8/20
2025-12-25 11:50:50,009 - INFO -   Profile 9/20
2025-12-25 11:52:26,201 - INFO -   Profile 10/20
2025-12-25 11:53:51,842 - INFO -   Profile 11/20
2025-12-25 11:55:20,284 - INFO -   Profile 12/20
2025-12-25 11:56:36,649 - INFO -   Profile 13/20
2025-12-25 11:58:06,896 - INFO -   Profile 14/20
2025-12-25 11:59:31,014 - INFO -   Profile 15/20
2025-12-25 12:00:48,734 - INFO -   Profile 16/20
2025-12-25 12:02:23,732 - INFO -   Profile 17/20
2025-12-25 12:03:20,783 - INFO -   Profile 18/20
2025-12-25 12:04:44,524 - INFO -   Profile 19/20
2025-12-25 12:06:08,471 - INFO -   Profile 20/20
2025-12-25 12:07:36,561 - INFO - Report saved to ../results/collab_baselines_20251225_105235/20251225_105243/report.md