2025-12-25 08:28:55,431 - INFO - Loaded dataset: math-500
2025-12-25 08:28:55,625 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
2025-12-25 08:28:55,626 - INFO - Running method: rag_vector
2025-12-25 08:28:55,626 - INFO -   Profile 1/2
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:06<00:18,  6.29s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:12<00:12,  6.41s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:21<00:07,  7.48s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:22<00:00,  4.89s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:22<00:00,  5.62s/it]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  20%|██        | 1/5 [00:09<00:36,  9.15s/it]
Loading checkpoint shards:  40%|████      | 2/5 [00:14<00:20,  6.98s/it]
Loading checkpoint shards:  60%|██████    | 3/5 [00:21<00:13,  6.76s/it]
Loading checkpoint shards:  80%|████████  | 4/5 [00:25<00:05,  5.99s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:28<00:00,  4.59s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:28<00:00,  5.61s/it]
The following generation flags are not valid and may be ignored: ['temperature', 'top_p', 'top_k']. Set `TRANSFORMERS_VERBOSITY=info` for more details.

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:02<00:06,  2.32s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:07<00:07,  3.73s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:10<00:03,  3.82s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.54s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.88s/it]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  20%|██        | 1/5 [00:01<00:07,  1.90s/it]
Loading checkpoint shards:  40%|████      | 2/5 [00:06<00:09,  3.22s/it]
Loading checkpoint shards:  60%|██████    | 3/5 [00:09<00:06,  3.34s/it]
Loading checkpoint shards:  80%|████████  | 4/5 [00:12<00:03,  3.28s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:13<00:00,  2.39s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:13<00:00,  2.70s/it]
2025-12-25 08:31:49,842 - INFO -   Profile 2/2

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:02<00:06,  2.32s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:06<00:07,  3.69s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:10<00:03,  3.82s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.50s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:11<00:00,  2.85s/it]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  20%|██        | 1/5 [00:01<00:07,  1.91s/it]
Loading checkpoint shards:  40%|████      | 2/5 [00:05<00:09,  3.07s/it]
Loading checkpoint shards:  60%|██████    | 3/5 [00:09<00:07,  3.58s/it]
Loading checkpoint shards:  80%|████████  | 4/5 [00:12<00:03,  3.35s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:13<00:00,  2.44s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:13<00:00,  2.76s/it]

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:02<00:06,  2.31s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:07<00:08,  4.03s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:11<00:04,  4.02s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:12<00:00,  2.69s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:12<00:00,  3.05s/it]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  20%|██        | 1/5 [00:01<00:07,  1.94s/it]
Loading checkpoint shards:  40%|████      | 2/5 [00:06<00:09,  3.32s/it]
Loading checkpoint shards:  60%|██████    | 3/5 [00:13<00:10,  5.23s/it]
Loading checkpoint shards:  80%|████████  | 4/5 [00:16<00:04,  4.33s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:17<00:00,  3.07s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:17<00:00,  3.50s/it]
2025-12-25 08:33:27,343 - INFO - Report saved to ../results/test_a100_20251225_082834/20251225_082855/report.md