跳到正文
返回论文列表
cs.CV提交于 已译

TurboWAM:学习快速世界动作模型的关键要素

TurboWAM: Learning What Matters for Fast World Action Models

Guile Wu · Shuangzhi Li · Xingxin Chen · Chengjie Huang · Sam Hosseini · Tongtong Cao · et al.

中文摘要

世界动作模型在机器人策略学习中展现出良好性能,但高推理延迟仍是现实部署的关键瓶颈。近期方法主要通过减少测试时未来帧想象或加速动作预测来提升效率,却常直接利用所有视频世界模型层的表征,未显式考虑各层与动作预测的相关性,造成冗余计算和表征利用不充分。TurboWAM 提出结构化世界表征聚合模块,依据不断变化的动作去噪状态,自适应融合不同世界模型层的表征;同时采用结构化动作监督机制,在反向传播时调节各层动作监督梯度,以促进世界表征学习。推理阶段减少执行的世界模型层数,并在动作去噪步骤间缓存相关表征,从而显著降低计算开销。多个机器人操作基准实验表明,TurboWAM 在保持具有竞争力的任务成功率的同时,实现了低推理延迟。

关键要点

  1. 01高推理延迟是世界动作模型投入机器人现实部署的主要瓶颈。
  2. 02结构化世界表征聚合模块按动作去噪状态融合相关层级表征。
  3. 03结构化动作监督自适应调节各世界模型层的监督梯度。
  4. 04推理时减少执行层数并跨去噪步骤缓存表征,降低计算开销。
  5. 05在多个机器人操作基准上兼顾低延迟与有竞争力的成功率。

解读

尚无解读。

原始英文摘要

arXiv:2610.33941v1 Announce Type: new Abstract: World action models have demonstrated promising performance in robot policy learning, yet their high inference latency remains a critical bottleneck for real-world deployment. Recent approaches have sought to improve inference efficiency by reducing test-time future-frame imagination or accelerating action prediction. However, these methods often leverage representations from all video world model layers without explicitly considering their varying relevance to action prediction, leading to redundant computation and suboptimal representation utilization. In this work, we propose TurboWAM, a fast world action model that efficiently aggregates structured world representations conditioned on action predictions. Specifically, TurboWAM introduces a structured world representation aggregation module that adaptively fuses representations from different world model layers according to their relevance to the evolving action denoising state. Furthermore, TurboWAM employs a structured action supervision mechanism that adaptively modulates gradients from action supervision across different world model layers during backward propagation, facilitating world representation learning. During inference, by reducing the number of world model layers executed and caching relevant representations across action denoising steps, TurboWAM substantially reduces computational overhead. Extensive experiments on multiple robot manipulation benchmarks demonstrate that TurboWAM achieves low inference latency while maintaining competitive task success rates compared with state-of-the-art methods.

同方向论文 · cs.CV

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联工具 · 1

Hugging Face Blog82

LeRobot v0.6.0 发布:引入世界模型策略、奖励模型 API 和新基准

LeRobot v0.6.0 发布,带来世界模型策略(VLA-JEPA、LingBot-VA、FastWAM)让机器人学会想象未来,以及一批新 VLA 模型(GR00T N1.7、MolmoAct2、EO-1、EVO1)。

推荐理由:原文给出了 world model policies、新 VLA 模型、reward models API 等具体能力变化,读者可以据此了解机器人学习工具链的最新进展。