跳到正文
返回论文列表
cs.RO提交于 已译

具身视觉语言模型的社会推理能力评估

Evaluating Social Reasoning in Embodied Vision-Language Models

Daniel Weiner · Raj Korpan

中文摘要

基础模型作为机器人团队的推理层,但具身专用视觉语言模型(VLM)是否保留通用VLM的社会推理能力尚不明确。在真实人机交互基准SHREC上评估Gemini Robotics-ER,并与通用VLM基线对比。Robotics-ER在错误/能力检测上优于GPT-4o-mini,但在详细社会属性判断上表现较差;添加视觉帧对一项任务有帮助,对另一项则有害。结果表明,具身专用模型在可直接从交互线索读取的社会判断与需推断内部状态的判断上表现不同。由于跨模型家族比较,差异不能仅归因于具身化。这对多机器人系统至关重要,共享基础模型可能导致系统性社会感知错误影响多个协调决策。本工作为初步评估,更广泛的跨上下文和视频分析留待未来工作。

关键要点

  1. 01评估具身专用VLM是否保留通用VLM的社会推理能力,填补具身模型社会认知评估空白。
  2. 02在SHREC基准上对比Gemini Robotics-ER与GPT-4o-mini,发现其在错误检测上更优但属性判断较弱。
  3. 03添加视觉帧对部分社会判断任务有正面影响,但对其他任务产生负面影响,显示任务依赖性。
  4. 04具身模型在直接线索判断与内部状态推断判断上表现差异显著,但跨家族比较限制归因于具身化。
  5. 05指出共享基础模型在多机器人系统中可能导致系统性社会感知错误,影响协调决策。

解读

尚无解读。

原始英文摘要

arXiv:2610.27496v1 Announce Type: new Abstract: Foundation models now serve as reasoning layers for robot teams, but it remains unclear whether embodiment-specialized vision-language models (VLMs) preserve the social-reasoning capabilities of general-purpose VLMs. We evaluate Gemini Robotics-ER on SHREC, a benchmark of real human-robot social interactions, and compare it with published general-purpose VLM baselines. Robotics-ER outperforms GPT-4o-mini on error/competence detection but performs worse on detailed social-attribute judgments; adding a visual frame helps one task while hurting the other. These results suggest embodiment-specialized models may perform differently on social judgments that can be read more directly from observable interaction cues versus those requiring more inference about a person's internal state. Because the comparison spans model families, these differences cannot be attributed to embodiment specialization alone. This matters for multi-robot systems, where a shared foundation model could cause systematic social-perception errors to influence multiple coordination decisions. This work presents an initial evaluation, with broader cross-context and video-based analyses left for future work.

同方向论文 · cs.RO

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联工具 · 1

Google DeepMind70

Google DeepMind 发布 Gemini Robotics-ER 1.6:增强实体推理赋能机器人任务

Google DeepMind 发布 Gemini Robotics-ER 1.6,这是其首个推理优先模型的重大升级版。该模型增强了空间推理和多视角理解能力,专门用于视觉与空间理解、任务规划和成功检测,并能原生调用工具如 Google Search、视觉语言动作模型或第三方函数。

推荐理由:原文给出了具体性能对比和新增的仪表读取功能,读者可以据此判断该模型在机器人实体推理场景中的具体提升和可用性。