跳到正文
返回论文列表
cs.CR提交于 已译

并非偶然:利用人形机器人安全过滤器的缺陷

Not an Accident: Exploiting Safety Filter Inadequacy in Humanoid Robots

Tiffany Bao · Shangtao Li · Yifan Sun · Mengwen He · Bowei Li · Alden Wang · et al.

中文摘要

随着人形机器人从研究实验室走向家庭、医院和仓库等以人为中心的环境,在人员与物体附近安全运行成为基本要求。安全过滤器通过数学保证控制动作不会引发碰撞,因而成为应对该问题的重要技术。相关保证仅在安全参数配置正确时成立,而参数配置依赖具体任务与环境,目前尚无通用方法可在多样部署中确定这些参数。因此,人形机器人附带的安全过滤器可能在部署后的特定场景中失效。攻击者只需通过普通用户交互即可利用这些失效,无需额外权限或能力。研究提出目标插入攻击,并开发自动化工具 SIREN,用于为给定任务与环境识别可导致插入目标脆弱性的攻击方案。实验表明,SIREN 在 SPARK 数据集的全部脆弱场景中均识别出攻击,发现的攻击数量是基线方法的 3 倍;还可针对真实人形机器人生成攻击,使机器人在执行任务时发生碰撞。结果显示,当前安全过滤器会引入可利用漏洞并导致安全违规,揭示现有安全机制本身可能成为人形机器人的安全风险来源。

关键要点

  1. 01指出现有安全过滤器仅在参数正确配置时提供防碰撞保证
  2. 02安全参数依赖任务和环境,跨部署确定配置仍无通用方法
  3. 03攻击者无需额外权限,仅凭普通用户交互即可触发缺陷
  4. 04SIREN 可自动发现脆弱插入目标,攻击数量为基线的 3 倍
  5. 05真实人形机器人实验显示,攻击可导致任务执行期间碰撞

解读

尚无解读。

原始英文摘要

arXiv:2610.31923v1 Announce Type: cross Abstract: As humanoid robots move from research laboratories toward deployment in human-centered environments such as homes, hospitals, and warehouses, safe operation around nearby people and objects becomes a fundamental requirement. Safety filters have emerged as a promising technique to address this challenge by providing mathematical guarantees that generated control actions do not result in collisions. This paper shows that these guarantees hold only when the safety parameters are configured correctly. However, correct parameter configurations are task- and environment-specific, and no general method exists to determine them across diverse deployments. As a result, safety filters shipped with humanoid robots can fail after deployment in specific scenarios. We show that attackers can exploit these failures through only normal user interactions without any additional privileges or capabilities. To demonstrate this risk, we present goal insertion attacks and develop SIREN, an automated tool that identifies vulnerable inserting goals for a given task and environment. Experimental results show that SIREN identifies attacks in all vulnerable scenarios in the SPARK dataset. Compared with a baseline approach, SIREN discovers three times as many attacks. We also show that SIREN is able to generate attacks against a real humanoid and cause it to collide while executing tasks. These results demonstrate that current safety filters introduce exploitable vulnerabilities that can cause safety violations, which reveals that existing safety mechanisms can themselves become a source of safety risk for humanoid robots.

同方向论文 · cs.CR

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 1

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Large Language Models Security Specialist

I want you to act as a Large Language Model security specialist. Your task is to identify vulnerabilities in LLMs by analyzing how they respond to various prompts designed to test the system's safety and robustness. I will provide some spec…