跳到正文
返回论文列表
cs.RO提交于 已译

ChunkVLA-AM: 增材制造中视觉语言动作机器人控制的并行动作分块

ChunkVLA-AM: Parallel Action Chunking for Vision-Language-Action Robot Control in Additive Manufacturing

Zhugang Liu · Kaichuang Zhang · Jinman Zhang · Pu Sun · Martha Asare · Jose Hernandez · et al.

中文摘要

视觉语言动作(VLA)模型统一视觉感知、语言理解和动作生成,为增材制造(AM)自动化带来新机遇。然而,在AM中部署仍具挑战:将这些模型适配到未见过的机器人本体成本高,且环境变化下性能可能下降。本工作提出在固定AM工作单元中部署OpenVLA-OFT到FAIRINO FR3机器人的框架。数据管道将单目真实世界演示转换为OpenVLA兼容的TFDS/RLDS数据集,以支持FR3本体适配。运行时每次推理请求预测8步7维动作块。FR3在获取新观测前开环执行每个动作块,提供动作块间的闭环反馈。该系统采用云边架构,FR3客户端通过FastAPI接口将观测流式传输到远程推理服务器。在42次物理A到B物体转移试验中(红色和蓝色目标各半),系统成功39次(92.9%)。3次失败均发生在最终放置阶段,由于释放高度控制不足导致物体倾倒。光照扫描发现低误差亮度范围为85-125(0-255尺度),最低平均空间误差在95。

关键要点

  1. 01VLA模型统一视觉、语言和动作能力,可用于AM自动化,但适配新机器人本体成本高且环境变化时性能下降
  2. 02通过数据管道将单目演示转换为TFDS/RLDS数据集,使OpenVLA-OFT能适配FAIRINO FR3机器人本体
  3. 03推理时每次预测8步7维动作块,机器人开环执行完动作块后再获取新观测形成闭环
  4. 04云边架构下机器人通过FastAPI将观测传到远程服务器进行推理
  5. 0542次物体转移试验成功39次(92.9%),失败都在最终放置阶段,光照亮度85-125时误差最低

解读

尚无解读。

原始英文摘要

arXiv:2610.01856v1 Announce Type: new Abstract: Vision-language-action (VLA) models unify visual perception, language understanding, and action generation, offering new opportunities for automation in additive manufacturing (AM). However, deployment in AM remains challenging because adapting these models to unseen robot embodiments is costly, and performance can degrade under environment changes. In this work, we present a framework for deploying OpenVLA-OFT on a FAIRINO FR3 robot in a fixed AM workcell. A data pipeline converts monocular real-world demonstrations into OpenVLA-compatible TFDS/RLDS datasets to support adaptation to the FR3 embodiment. At runtime, each inference request predicts an eight-step chunk of 7-D actions. The FR3 executes each chunk open loop before capturing a new observation, providing closed-loop feedback between chunks. The system uses a cloud-edge architecture in which the FR3 client streams observations to a remote inference server through a FastAPI interface. In 42 physical A-to-B object-transfer trials, evenly split between red and blue targets, the system succeeded in 39 (92.9%). All three failures occurred during final placement, when insufficient release-height control caused the object to topple. An illumination sweep identified a low-error luminance range of 85-125 on a 0-255 scale, with the lowest mean spatial error at 95.

同方向论文 · cs.RO

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 2

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Android AI App Security Specialist Task

Act as an Android AI App Security Specialist. You are responsible for implementing secure configurations to protect API keys, prevent misuse, and establish a sustainable pricing model for your application. Your tasks include: 1. **Backend…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

AI Engineer

--- name: ai-engineer description: "Use this agent when implementing AI/ML features, integrating language models, building recommendation systems, or adding intelligent automation to applications. This agent specializes in practical AI impl…