Add collaborativeagents module and update gitignore

- Add collaborativeagents subproject with adapters, agents, and evaluation modules
- Update .gitignore to exclude large binary files (.whl, .tar), wandb logs, and results

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

1 files changed, 97 insertions, 0 deletions

diff --git a/collaborativeagents/slurm/logs/full_exp_14358390.err b/collaborativeagents/slurm/logs/full_exp_14358390.err
new file mode 100644
index 0000000..65669a6
--- /dev/null
+++ b/collaborativeagents/slurm/logs/full_exp_14358390.err
@@ -0,0 +1,97 @@
+/u/yurenh2/miniforge3/envs/eval/lib/python3.11/site-packages/transformers/utils/hub.py:110: FutureWarning: Using `TRANSFORMERS_CACHE` is deprecated and will be removed in v5 of Transformers. Use `HF_HOME` instead.
+  warnings.warn(
+2025-12-26 11:03:58,116 - INFO - Loaded dataset: mmlu
+2025-12-26 11:03:58,116 - INFO - Loaded dataset: aime
+2025-12-26 11:03:58,116 - INFO - Loaded dataset: math-hard
+2025-12-26 11:03:58,116 - INFO - Loaded dataset: humaneval
+2025-12-26 11:03:58,213 - INFO - Loaded 100 profiles from ../data/complex_profiles_v2/profiles_100.jsonl
+2025-12-26 11:03:58,214 - INFO - Running method: vanilla
+`torch_dtype` is deprecated! Use `dtype` instead!
+
Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:05<00:16,  5.63s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:10<00:10,  5.11s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:17<00:05,  5.89s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:17<00:00,  3.87s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:17<00:00,  4.49s/it]
+
Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  20%|██        | 1/5 [00:05<00:23,  5.84s/it]
Loading checkpoint shards:  40%|████      | 2/5 [00:09<00:14,  4.82s/it]
Loading checkpoint shards:  60%|██████    | 3/5 [00:15<00:10,  5.19s/it]
Loading checkpoint shards:  80%|████████  | 4/5 [00:19<00:04,  4.64s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:21<00:00,  3.64s/it]
Loading checkpoint shards: 100%|██████████| 5/5 [00:21<00:00,  4.25s/it]
+2025-12-26 11:04:49,945 - INFO -   Profile 1/30
+
Generating test split:   0%|          | 0/100 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 100/100 [00:00<00:00, 1179.52 examples/s]
+
Generating validation split:   0%|          | 0/11 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 11/11 [00:00<00:00, 3170.95 examples/s]
+
Generating dev split:   0%|          | 0/5 [00:00<?, ? examples/s]
Generating dev split: 100%|██████████| 5/5 [00:00<00:00, 1567.85 examples/s]
+
Generating test split:   0%|          | 0/100 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 100/100 [00:00<00:00, 21317.94 examples/s]
+
Generating validation split:   0%|          | 0/11 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 11/11 [00:00<00:00, 3131.14 examples/s]
+
Generating dev split:   0%|          | 0/5 [00:00<?, ? examples/s]
Generating dev split: 100%|██████████| 5/5 [00:00<00:00, 1635.46 examples/s]
+
Generating test split:   0%|          | 0/102 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 102/102 [00:00<00:00, 22671.91 examples/s]
+
Generating validation split:   0%|          | 0/11 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 11/11 [00:00<00:00, 3275.40 examples/s]
+
Generating dev split:   0%|          | 0/5 [00:00<?, ? examples/s]
Generating dev split: 100%|██████████| 5/5 [00:00<00:00, 1562.01 examples/s]
+
Generating test split:   0%|          | 0/126 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 126/126 [00:00<00:00, 22251.89 examples/s]
+
Generating validation split:   0%|          | 0/14 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 14/14 [00:00<00:00, 3442.39 examples/s]
+
Generating dev split:   0%|          | 0/5 [00:00<?, ? examples/s]
Generating dev split: 100%|██████████| 5/5 [00:00<00:00, 1582.64 examples/s]
+
Generating test split:   0%|          | 0/151 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 151/151 [00:00<00:00, 33935.59 examples/s]
+
Generating validation split:   0%|          | 0/17 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 17/17 [00:00<00:00, 5068.47 examples/s]
+
Generating dev split:   0%|          | 0/5 [00:00<?, ? examples/s]
Generating dev split: 100%|██████████| 5/5 [00:00<00:00, 1145.67 examples/s]
+
Generating test split:   0%|          | 0/112 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 112/112 [00:00<00:00, 28756.25 examples/s]
+
Generating validation split:   0%|          | 0/11 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 11/11 [00:00<00:00, 1310.68 examples/s]
+
Generating dev split:   0%|          | 0/5 [00:00<?, ? examples/s]
Generating dev split: 100%|██████████| 5/5 [00:00<00:00, 1548.86 examples/s]
+/u/yurenh2/miniforge3/envs/eval/lib/python3.11/site-packages/awq/__init__.py:21: DeprecationWarning: 
+I have left this message as the final dev message to help you transition.
+
+Important Notice:
+- AutoAWQ is officially deprecated and will no longer be maintained.
+- The last tested configuration used Torch 2.6.0 and Transformers 4.51.3.
+- If future versions of Transformers break AutoAWQ compatibility, please report the issue to the Transformers project.
+
+Alternative:
+- AutoAWQ has been adopted by the vLLM Project: https://github.com/vllm-project/llm-compressor
+
+For further inquiries, feel free to reach out:
+- X: https://x.com/casper_hansen_
+- LinkedIn: https://www.linkedin.com/in/casper-hansen-804005170/
+
+  warnings.warn(_FINAL_DEV_MESSAGE, category=DeprecationWarning, stacklevel=1)
+
Loading checkpoint shards:   0%|          | 0/9 [00:00<?, ?it/s]
Loading checkpoint shards:  11%|█         | 1/9 [00:05<00:44,  5.50s/it]
Loading checkpoint shards:  22%|██▏       | 2/9 [04:02<16:31, 141.68s/it]
Loading checkpoint shards:  33%|███▎      | 3/9 [04:07<07:54, 79.14s/it] 
Loading checkpoint shards:  44%|████▍     | 4/9 [04:13<04:11, 50.20s/it]
Loading checkpoint shards:  56%|█████▌    | 5/9 [04:18<02:16, 34.13s/it]
Loading checkpoint shards:  67%|██████▋   | 6/9 [04:24<01:13, 24.38s/it]
Loading checkpoint shards:  78%|███████▊  | 7/9 [05:50<01:29, 44.64s/it]
Loading checkpoint shards:  89%|████████▉ | 8/9 [05:53<00:31, 31.48s/it]
Loading checkpoint shards: 100%|██████████| 9/9 [05:55<00:00, 22.11s/it]
Loading checkpoint shards: 100%|██████████| 9/9 [05:55<00:00, 39.48s/it]
+2025-12-26 11:22:36,555 - WARNING - User agent failed to respond at turn 3
+2025-12-26 11:38:11,820 - WARNING - User agent failed to respond at turn 4
+2025-12-26 11:49:23,100 - WARNING - User agent failed to respond at turn 2
+2025-12-26 12:02:46,057 - INFO -   Profile 2/30
+2025-12-26 12:15:14,260 - WARNING - User agent failed to respond at turn 5
+2025-12-26 12:43:01,887 - INFO -   Profile 3/30
+2025-12-26 13:16:25,157 - WARNING - User agent failed to respond at turn 3
+2025-12-26 13:19:41,611 - WARNING - User agent failed to respond at turn 4
+2025-12-26 13:31:32,934 - INFO -   Profile 4/30
+2025-12-26 13:44:18,881 - WARNING - User agent failed to respond at turn 2
+2025-12-26 13:50:24,735 - WARNING - User agent failed to respond at turn 3
+2025-12-26 14:22:35,201 - WARNING - User agent failed to respond at turn 4
+2025-12-26 14:28:33,134 - INFO -   Profile 5/30
+2025-12-26 15:08:47,500 - INFO -   Profile 6/30
+2025-12-26 15:11:23,025 - WARNING - User agent failed to respond at turn 4
+2025-12-26 15:16:01,352 - WARNING - User agent failed to respond at turn 3
+2025-12-26 15:42:13,161 - WARNING - User agent failed to respond at turn 4
+2025-12-26 15:46:22,086 - WARNING - User agent failed to respond at turn 6
+2025-12-26 15:56:17,527 - WARNING - User agent failed to respond at turn 4
+2025-12-26 16:07:50,432 - WARNING - User agent failed to respond at turn 6
+2025-12-26 16:07:50,434 - INFO -   Profile 7/30
+2025-12-26 16:17:55,588 - WARNING - User agent failed to respond at turn 2
+2025-12-26 16:33:05,425 - WARNING - User agent failed to respond at turn 3
+2025-12-26 16:56:24,660 - WARNING - User agent failed to respond at turn 3
+2025-12-26 17:08:04,806 - INFO -   Profile 8/30
+2025-12-26 18:12:23,818 - WARNING - User agent failed to respond at turn 3
+2025-12-26 18:15:59,440 - INFO -   Profile 9/30
+2025-12-26 18:25:15,857 - WARNING - User agent failed to respond at turn 3
+2025-12-26 18:27:49,419 - WARNING - User agent failed to respond at turn 3
+2025-12-26 18:57:08,009 - INFO -   Profile 10/30
+2025-12-26 19:36:53,452 - WARNING - User agent failed to respond at turn 2
+2025-12-26 19:54:08,446 - INFO -   Profile 11/30
+2025-12-26 20:09:55,735 - WARNING - User agent failed to respond at turn 3
+2025-12-26 20:40:31,861 - INFO -   Profile 12/30
+2025-12-26 21:14:56,537 - WARNING - User agent failed to respond at turn 3
+2025-12-26 21:28:00,763 - WARNING - User agent failed to respond at turn 3
+2025-12-26 21:28:00,764 - INFO -   Profile 13/30
+2025-12-26 22:12:17,605 - INFO -   Profile 14/30
+2025-12-26 22:35:24,416 - WARNING - User agent failed to respond at turn 4
+2025-12-26 22:59:55,984 - INFO -   Profile 15/30
+2025-12-26 23:10:51,206 - WARNING - User agent failed to respond at turn 2
+2025-12-26 23:23:48,320 - WARNING - User agent failed to respond at turn 3
+2025-12-26 23:41:06,303 - INFO -   Profile 16/30
+2025-12-27 00:26:43,745 - INFO -   Profile 17/30
+2025-12-27 00:51:28,080 - WARNING - User agent failed to respond at turn 5
+2025-12-27 01:04:15,959 - WARNING - User agent failed to respond at turn 2
+2025-12-27 01:11:14,362 - WARNING - User agent failed to respond at turn 3
+2025-12-27 01:16:42,254 - WARNING - User agent failed to respond at turn 3
+2025-12-27 01:22:35,316 - INFO -   Profile 18/30
+[2025-12-27T01:24:47.209] error: *** JOB 14358390 ON gpua035 CANCELLED AT 2025-12-27T01:24:47 DUE to SIGNAL Terminated ***