跳到正文
返回论文列表
cs.IR提交于 已译

IRAH:面向检索流程优化的分层智能体树搜索

IRAH: Hierarchical Agentic Tree Search for Retrieval Pipeline Optimization

Maria Ana Cardei · Aniket Singh · Amir Moghadam · Srividhya Baikadi · Rashmi Shetty

中文摘要

为检索增强生成(RAG)优化信息检索(IR)流程,需要在有限评估预算下联合选择结构组件与数值超参数。信息检索智能体测试框架(IRAH)将IR语言智能体树搜索(LATS-IR)与离线元学习初始化结合。LATS-IR执行UCT引导的分层搜索,先探索宏观流程结构,再细化数值参数,并通过自然语言反思指导后续变更,提供可检查的搜索轨迹。IRAH在三个同分布基准和一个分布外基准上评估,以考察分布偏移下的泛化能力。在相同元学习初始化下,LATS-IR在三个同分布基准中的两个上优于TPE,最高提升6.4%,并在分布外基准上保持竞争力。四个基准上,热启动IRAH取得最高平均留出nDCG@10(0.4816),且优于冷启动版本。结果表明,IRAH是在受限评估预算下优化检索流程的一种有竞争力的方法。

关键要点

  1. 01在有限评估预算下联合优化IR流程结构与数值超参数
  2. 02结合LATS-IR、UCT分层搜索和离线元学习初始化
  3. 03通过自然语言反思生成可检查的搜索轨迹
  4. 04在两个同分布基准上优于TPE,最高提升6.4%
  5. 05四个基准上热启动IRAH平均留出nDCG@10最高

解读

尚无解读。

原始英文摘要

arXiv:2610.30167v1 Announce Type: cross Abstract: Optimizing Information Retrieval (IR) pipelines for Retrieval-Augmented Generation (RAG) requires jointly selecting structural components and numerical hyperparameters under limited evaluation budgets. We introduce the Information Retrieval Agentic Harness (IRAH), which combines Language Agent Tree Search for IR (LATS-IR) with offline meta-learned initialization. LATS-IR performs UCT-guided hierarchical search, first exploring macro-structural pipeline choices and then refining numerical parameters, with natural-language reflections to guide subsequent mutations and provide inspectable search traces. We evaluate IRAH on three in-distribution benchmarks and one out of-distribution benchmark to assess generalization under distribution shift. Under the same meta-learned initialization, LATS-IR outperforms TPE on two of three in-distribution benchmarks, with gains of up to 6.4%, and remains competitive on the out-of-distribution benchmark. Across all four benchmarks, warm-started IRAH achieves the highest average held-out nDCG@10 (0.4816) and improves over its cold-start counterpart. These results establish IRAH as a competitive approach to retrieval pipeline optimization under constrained evaluation budgets.

同方向论文 · cs.IR

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 1

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Paper to Practice

You turn research papers into practical takeaways for the user. - Topics are set by the user (edit this list): e.g. retrieval, agents, evaluation. - Each run, find new papers on arXiv and well-known lab blogs. Pick at most 5 that are likel…