diff options
| author | YurenHao0426 <blackhao0426@gmail.com> | 2026-02-11 00:21:34 +0000 |
|---|---|---|
| committer | YurenHao0426 <blackhao0426@gmail.com> | 2026-02-11 00:21:34 +0000 |
| commit | 08a08befe8ac0202ce952b88aa144cbffe2a73f9 (patch) | |
| tree | 0924f46f398cff21c22c16affb70cbfdc770c03f /collaborativeagents/adapters/personalized_llm_adapter.py | |
| parent | d5e38fb958403563bf90e884d96660731b1e0379 (diff) | |
Add dual-vector ablation experiment (z_short/z_long necessity)
- Add rag_vector_no_short (eta_short=0) and rag_vector_no_long (eta_long=0) configs
- Add ablation run script for 60p60s experiment
- Document ablation design and expected results in notes
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Diffstat (limited to 'collaborativeagents/adapters/personalized_llm_adapter.py')
| -rw-r--r-- | collaborativeagents/adapters/personalized_llm_adapter.py | 34 |
1 files changed, 34 insertions, 0 deletions
diff --git a/collaborativeagents/adapters/personalized_llm_adapter.py b/collaborativeagents/adapters/personalized_llm_adapter.py index 488b241..4189f31 100644 --- a/collaborativeagents/adapters/personalized_llm_adapter.py +++ b/collaborativeagents/adapters/personalized_llm_adapter.py @@ -672,6 +672,40 @@ def create_baseline_adapter( "extractor": "cuda:2", }, ), + # Ablation: RAG + Vector without z_short (only z_long, no within-session adaptation) + "rag_vector_no_short": AdapterConfig( + mode="full", + enable_preference_extraction=True, + enable_rl_updates=True, + use_user_vector=True, + llm_name=llm_name, + use_shared_models=use_shared_models, + enable_query_transform=True, + enable_global_preferences=True, + eta_short=0.0, # Disable z_short learning + device_assignment={ + "embed": "cuda:2", + "reranker": "cuda:3", + "extractor": "cuda:2", + }, + ), + # Ablation: RAG + Vector without z_long (only z_short, no cross-session learning) + "rag_vector_no_long": AdapterConfig( + mode="full", + enable_preference_extraction=True, + enable_rl_updates=True, + use_user_vector=True, + llm_name=llm_name, + use_shared_models=use_shared_models, + enable_query_transform=True, + enable_global_preferences=True, + eta_long=0.0, # Disable z_long learning + device_assignment={ + "embed": "cuda:2", + "reranker": "cuda:3", + "extractor": "cuda:2", + }, + ), # Baseline 7a: RAG + Vector + Preference Rewrite (combines best of both) "rag_rewrite_vector": AdapterConfig( mode="full", |
