跳到正文
返回论文列表
cs.RO提交于 已译

迈向 Physical AI 的递归自我改进

Toward Recursive Self-Improvement in Physical AI

Meng Luo · Zechen Bai · Shanqing Xu · Yanlin Li · Kaixin Li · Mengchen Qian · et al.

中文摘要

递归自我改进(recursive self-improvement,RSI)不仅提升系统行为,也改进其自我改进过程。数字智能体可通过重写代码并用可执行测试验证版本,但引入物理世界后,系统必须从局部观测和昂贵试验中学习,同时应对运行条件变化及可能不可逆的后果。论文将 RSI 定位于机器人学习,梳理从提升机器人能力到改进能力生成过程的路径,并考察物理经验如何强化改进机制,以及这些收益何时能支持机制自身的进一步改进。收益延续需满足四项条件:反馈契合尚存的学习需求、接收组件能够利用变化、价值可跨任务或硬件变化保留,且持续练习安全且成本可控。现有研究主要集中于操作任务,支持行为改进、对后续学习的益处及流程改进;部分系统也会改变改进者的知识或工具,但所综述的物理研究尚未单独分离递归带来的收益。论文据此提出评估原则与研究方向,探索机器如何在逐次试验中安全改进其改进方式。

关键要点

  1. 01将递归自我改进置于机器人学习语境,区分能力提升与改进过程优化
  2. 02物理经验可强化改进机制,但反馈、组件、迁移与成本约束收益延续
  3. 03现有物理研究主要见于操作任务,能改善行为、后续学习与流程
  4. 04部分系统调整改进者的知识或工具,但递归贡献尚未被单独识别
  5. 05提出安全、渐进式自我改进的评估原则与后续研究方向

解读

尚无解读。

原始英文摘要

arXiv:2610.29677v1 Announce Type: new Abstract: Recursive self-improvement (RSI) describes a system that improves not only its behavior but also the process by which it improves. Recent digital agents test this idea by rewriting their own code and checking each version with executable tests. Bringing these mechanisms into the physical world requires learning from partial observations through costly trials, while accounting for changing operating conditions and potentially irreversible consequences. We position RSI within robot learning and trace pathways from improving robot capabilities to improving the processes that generate them. We examine how physical experience can strengthen these improvement mechanisms and when the resulting gains can support further self-improvement of the mechanisms themselves. Gains carry forward only when feedback addresses remaining learning needs, the receiving component can use the change, its value survives changes in tasks or hardware, and continued practice remains safe and affordable. Existing studies, concentrated in manipulation, support behavioral improvement, benefits to later learning, and procedure improvement. Some systems also change the improver's knowledge or tools, but the physical studies reviewed here have yet to isolate gains attributable to recursion. We synthesize these findings into evaluation principles and research directions for machines that, trial by trial, safely improve the way they improve.

同方向论文 · cs.RO

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Weekend Planner

- Read the weekend weather, calendar and budget. - Find local events, hikes, exhibitions and restaurants. - Propose 3 plans: adventure, cozy, social, with times and costs. - Prepare reservation steps; book nothing without approval. - Rememb…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Android AI App Security Specialist Task

Act as an Android AI App Security Specialist. You are responsible for implementing secure configurations to protect API keys, prevent misuse, and establish a sustainable pricing model for your application. Your tasks include: 1. **Backend…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Update Agent Permissions

# Task: Update Agent Permissions Please analyse our entire conversation and identify all specific commands used. Update permissions for both Claude Code and Gemini CLI. ## Reference Files - Claude: ~/.claude/settings.json - Gemini polic…