diff options
| author | YurenHao0426 <blackhao0426@gmail.com> | 2026-02-11 00:21:34 +0000 |
|---|---|---|
| committer | YurenHao0426 <blackhao0426@gmail.com> | 2026-02-11 00:21:34 +0000 |
| commit | 08a08befe8ac0202ce952b88aa144cbffe2a73f9 (patch) | |
| tree | 0924f46f398cff21c22c16affb70cbfdc770c03f /collaborativeagents/scripts/run_experiments.py | |
| parent | d5e38fb958403563bf90e884d96660731b1e0379 (diff) | |
Add dual-vector ablation experiment (z_short/z_long necessity)
- Add rag_vector_no_short (eta_short=0) and rag_vector_no_long (eta_long=0) configs
- Add ablation run script for 60p60s experiment
- Document ablation design and expected results in notes
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Diffstat (limited to 'collaborativeagents/scripts/run_experiments.py')
| -rw-r--r-- | collaborativeagents/scripts/run_experiments.py | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/collaborativeagents/scripts/run_experiments.py b/collaborativeagents/scripts/run_experiments.py index da3549b..806b959 100644 --- a/collaborativeagents/scripts/run_experiments.py +++ b/collaborativeagents/scripts/run_experiments.py @@ -118,6 +118,8 @@ AVAILABLE_METHODS = { "rag_rewrite": "Extractor + RAG with LLM preference rewrite/merge", "rag_rewrite_vector": "Extractor + RAG + user vector + LLM preference rewrite", "rag_vector": "Extractor + RAG + user vector (proposed method)", + "rag_vector_no_short": "Ablation: RAG + user vector without z_short (long-term only)", + "rag_vector_no_long": "Ablation: RAG + user vector without z_long (short-term only)", "rag_vector_fast": "Extractor + RAG + user vector with 10x learning rate", "rag_vector_consolidate": "Extractor + RAG + user vector with session-level preference consolidation", "rag_vector_balanced": "Extractor + RAG + user vector with balanced rewards (10x LR + positive signal for good turns)", |