LeRobot v0.6.0 发布:引入世界模型策略、奖励模型 API 和新基准
LeRobot v0.6.0 发布,带来世界模型策略(VLA-JEPA、LingBot-VA、FastWAM)让机器人学会想象未来,以及一批新 VLA 模型(GR00T N1.7、MolmoAct2、EO-1、EVO1)。
推荐理由:原文给出了 world model policies、新 VLA 模型、reward models API 等具体能力变化,读者可以据此了解机器人学习工具链的最新进展。
TurboWAM: Learning What Matters for Fast World Action Models
Guile Wu · Shuangzhi Li · Xingxin Chen · Chengjie Huang · Sam Hosseini · Tongtong Cao · et al.
世界动作模型在机器人策略学习中展现出良好性能,但高推理延迟仍是现实部署的关键瓶颈。近期方法主要通过减少测试时未来帧想象或加速动作预测来提升效率,却常直接利用所有视频世界模型层的表征,未显式考虑各层与动作预测的相关性,造成冗余计算和表征利用不充分。TurboWAM 提出结构化世界表征聚合模块,依据不断变化的动作去噪状态,自适应融合不同世界模型层的表征;同时采用结构化动作监督机制,在反向传播时调节各层动作监督梯度,以促进世界表征学习。推理阶段减少执行的世界模型层数,并在动作去噪步骤间缓存相关表征,从而显著降低计算开销。多个机器人操作基准实验表明,TurboWAM 在保持具有竞争力的任务成功率的同时,实现了低推理延迟。
尚无解读。
arXiv:2610.33941v1 Announce Type: new Abstract: World action models have demonstrated promising performance in robot policy learning, yet their high inference latency remains a critical bottleneck for real-world deployment. Recent approaches have sought to improve inference efficiency by reducing test-time future-frame imagination or accelerating action prediction. However, these methods often leverage representations from all video world model layers without explicitly considering their varying relevance to action prediction, leading to redundant computation and suboptimal representation utilization. In this work, we propose TurboWAM, a fast world action model that efficiently aggregates structured world representations conditioned on action predictions. Specifically, TurboWAM introduces a structured world representation aggregation module that adaptively fuses representations from different world model layers according to their relevance to the evolving action denoising state. Furthermore, TurboWAM employs a structured action supervision mechanism that adaptively modulates gradients from action supervision across different world model layers during backward propagation, facilitating world representation learning. During inference, by reducing the number of world model layers executed and caching relevant representations across action denoising steps, TurboWAM substantially reduces computational overhead. Extensive experiments on multiple robot manipulation benchmarks demonstrate that TurboWAM achieves low inference latency while maintaining competitive task success rates compared with state-of-the-art methods.
LeRobot v0.6.0 发布,带来世界模型策略(VLA-JEPA、LingBot-VA、FastWAM)让机器人学会想象未来,以及一批新 VLA 模型(GR00T N1.7、MolmoAct2、EO-1、EVO1)。
推荐理由:原文给出了 world model policies、新 VLA 模型、reward models API 等具体能力变化,读者可以据此了解机器人学习工具链的最新进展。