1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
|
2025-12-25 10:52:43,142 - INFO - Loaded dataset: math-500
2025-12-25 10:52:43,385 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
2025-12-25 10:52:43,386 - INFO - Running method: contextual
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:06<00:19, 6.47s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:12<00:12, 6.43s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:18<00:06, 6.24s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:20<00:00, 4.59s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:20<00:00, 5.24s/it]
2025-12-25 10:53:08,251 - INFO - Profile 1/20
2025-12-25 10:54:31,245 - INFO - Profile 2/20
2025-12-25 10:55:49,021 - INFO - Profile 3/20
2025-12-25 10:57:07,721 - INFO - Profile 4/20
2025-12-25 10:57:46,873 - INFO - Profile 5/20
2025-12-25 10:58:26,077 - INFO - Profile 6/20
2025-12-25 10:59:05,298 - INFO - Profile 7/20
2025-12-25 10:59:44,507 - INFO - Profile 8/20
2025-12-25 11:00:23,700 - INFO - Profile 9/20
2025-12-25 11:01:02,919 - INFO - Profile 10/20
2025-12-25 11:01:42,131 - INFO - Profile 11/20
2025-12-25 11:02:57,684 - INFO - Profile 12/20
2025-12-25 11:03:56,775 - INFO - Profile 13/20
2025-12-25 11:05:03,753 - INFO - Profile 14/20
2025-12-25 11:05:51,697 - INFO - Profile 15/20
2025-12-25 11:06:52,101 - INFO - Profile 16/20
2025-12-25 11:07:27,746 - INFO - Profile 17/20
2025-12-25 11:08:54,497 - INFO - Profile 18/20
2025-12-25 11:10:40,288 - INFO - Profile 19/20
2025-12-25 11:12:07,984 - INFO - Profile 20/20
2025-12-25 11:12:44,173 - INFO - Running method: reflection
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:06<00:18, 6.00s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:13<00:13, 6.60s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:20<00:06, 6.78s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00, 4.87s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00, 5.49s/it]
2025-12-25 11:13:06,758 - INFO - Profile 1/20
2025-12-25 11:14:12,362 - INFO - Profile 2/20
2025-12-25 11:15:35,445 - INFO - Profile 3/20
2025-12-25 11:16:54,467 - INFO - Profile 4/20
2025-12-25 11:18:12,199 - INFO - Profile 5/20
2025-12-25 11:19:42,312 - INFO - Profile 6/20
2025-12-25 11:21:06,922 - INFO - Profile 7/20
2025-12-25 11:22:54,996 - INFO - Profile 8/20
2025-12-25 11:24:08,753 - INFO - Profile 9/20
2025-12-25 11:25:19,792 - INFO - Profile 10/20
2025-12-25 11:26:42,922 - INFO - Profile 11/20
2025-12-25 11:28:16,287 - INFO - Profile 12/20
2025-12-25 11:29:37,361 - INFO - Profile 13/20
2025-12-25 11:30:51,174 - INFO - Profile 14/20
2025-12-25 11:32:25,617 - INFO - Profile 15/20
2025-12-25 11:33:26,202 - INFO - Profile 16/20
2025-12-25 11:34:28,137 - INFO - Profile 17/20
2025-12-25 11:35:45,693 - INFO - Profile 18/20
2025-12-25 11:37:00,624 - INFO - Profile 19/20
2025-12-25 11:38:12,427 - INFO - Profile 20/20
2025-12-25 11:39:29,675 - INFO - Running method: reflection_grpo
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:06<00:18, 6.18s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:13<00:13, 6.71s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:19<00:06, 6.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00, 4.71s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:21<00:00, 5.35s/it]
2025-12-25 11:39:51,748 - INFO - Profile 1/20
2025-12-25 11:41:06,412 - INFO - Profile 2/20
2025-12-25 11:42:24,983 - INFO - Profile 3/20
2025-12-25 11:43:42,715 - INFO - Profile 4/20
2025-12-25 11:45:21,420 - INFO - Profile 5/20
2025-12-25 11:46:41,875 - INFO - Profile 6/20
2025-12-25 11:48:09,967 - INFO - Profile 7/20
2025-12-25 11:49:25,792 - INFO - Profile 8/20
2025-12-25 11:50:50,009 - INFO - Profile 9/20
2025-12-25 11:52:26,201 - INFO - Profile 10/20
2025-12-25 11:53:51,842 - INFO - Profile 11/20
2025-12-25 11:55:20,284 - INFO - Profile 12/20
2025-12-25 11:56:36,649 - INFO - Profile 13/20
2025-12-25 11:58:06,896 - INFO - Profile 14/20
2025-12-25 11:59:31,014 - INFO - Profile 15/20
2025-12-25 12:00:48,734 - INFO - Profile 16/20
2025-12-25 12:02:23,732 - INFO - Profile 17/20
2025-12-25 12:03:20,783 - INFO - Profile 18/20
2025-12-25 12:04:44,524 - INFO - Profile 19/20
2025-12-25 12:06:08,471 - INFO - Profile 20/20
2025-12-25 12:07:36,561 - INFO - Report saved to ../results/collab_baselines_20251225_105235/20251225_105243/report.md
|
