跳到正文
返回论文列表
cs.RO提交于 已译

机器人系统的多工具选择:语义检索与 LLM 对比

Multi-Tool Selection for Robotic Systems: Comparing Semantic Retrieval and LLM

Miguel Sousa · Luis Ramos Pinto · Jo\~ao P. Matos-Carvalho

中文摘要

自然语言接口使用户无需直接操作任务规划器或机器人中间件即可控制系统,但可靠性取决于工具路由,即选择满足请求所需的最小完整预定义可执行能力集合。对于复合指令,选择不完整可能遗漏必要的感知或监控能力,选择过多则可能暴露无关工具。研究比较四种路由策略:三种逐步改进的 ChromaDB 方法——固定阈值检索、相对距离检索和子句感知聚合检索,以及一个云端 1200 亿参数语言模型基线。实验采用 164 条人工标注提示,按三个复杂度等级组织,从单工具直接请求到至少需要三个工具的复合请求。评价指标包括精确匹配准确率、完整率、精确率、完整率加权综合分数和路由延迟。CDB-v3 在仅检索方法中取得最佳宏平均分,为 0.7822,但仍低于大模型基线的 0.8869。尽管 LLM 的路由质量更高,CDB-v3 的延迟显著更低,且可在本地部署,无需云连接。结果表明,直接大模型选择与子句感知语义检索之间存在质量—延迟权衡。

关键要点

  1. 01机器人工具路由需从预定义能力中选出满足请求的最小完整集合。
  2. 02比较三种 ChromaDB 检索方法与云端 1200 亿参数语言模型基线。
  3. 03实验覆盖 164 条人工标注提示及三个复杂度等级。
  4. 04CDB-v3 在检索方法中得分最高,但仍低于 LLM 基线。
  5. 05CDB-v3 延迟更低,并支持无云连接的本地部署。

解读

尚无解读。

原始英文摘要

arXiv:2610.31013v1 Announce Type: new Abstract: Natural-language interfaces allow users to command robotic systems without interacting directly with mission planners or robotics middleware. Their reliable use depends on robot tool routing, defined here as the selection of the smallest complete subset of predefined executable capabilities required to satisfy a request. This task is particularly difficult for compound instructions, where incomplete selection may omit necessary sensing or monitoring capabilities, while excessive selection may expose irrelevant tools. We compare four routing strategies: three progressively refined ChromaDB-based methods - fixed-threshold retrieval, relative-distance retrieval, and clause-aware aggregated retrieval - and a cloud-hosted 120-billion-parameter language-model baseline. The methods are evaluated on 164 manually annotated prompts organised into three complexity levels, from direct single-tool requests to compound requests requiring at least three tools. Using exact-match accuracy, completeness, precision, a completeness-weighted composite score, and routing latency, CDB-v3 achieves the best macro-average score among the retrieval-only methods, with 0.7822, compared with 0.8869 for the large-model baseline. Although the LLM provides higher routing quality, CDB-v3 exhibits substantially lower latency and can be deployed locally without requiring cloud connectivity. These results identify a quality-latency trade-off between direct large-model selection and clause-aware semantic retrieval for privacy-sensitive, connectivity-constrained, and resource-constrained robotic systems.

同方向论文 · cs.RO

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Weekend Planner

- Read the weekend weather, calendar and budget. - Find local events, hikes, exhibitions and restaurants. - Propose 3 plans: adventure, cozy, social, with times and costs. - Prepare reservation steps; book nothing without approval. - Rememb…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Task Planner

--- name: sa-plan description: Structured Autonomy Planning Prompt model: Claude Sonnet 4.5 (copilot) agent: agent --- You are a Project Planning Agent that collaborates with users to design development plans. A development plan defines a…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

CLI silently install software on windows

Ask me for the name of the software as your next question. - You are an IT expert technican. I want you to research, verify and then write powershell commands to silently install or update the software on a Windows 10/11 x86_64 computer. …