跳到正文
返回论文列表
cs.MM提交于 已译

Cassette-Editor:像你一样剪辑的视频编辑智能体

Cassette-Editor: A Video Editing Agent That Edits the Way You Do

Zhixin Zeng · Jiahao Zhong

中文摘要

语言智能体日益通过在持久化产物(如代码仓库)上调用工具来工作,每次调用的结果决定其下一步。视频编辑是这一模式的严苛案例:一帧画面取决于每个片段如何裁剪、变速、裁切与嵌套,因此关于素材的知识只对特定用法成立,一次无效编辑就可能让时间线结构损坏。现有视频编辑智能体依靠评审智能体、审核器或受限输出格式来保持编辑有效。Cassette-Editor 采用刻意简单的接口:一个工具读取项目,一个工具写入项目。每次写入都经过与用户手动编辑相同的执行器、规则与提交服务,要么原子提交,要么被拒绝并给出定位诊断与修复选项,而模型保留创作选择并决定如何恢复。读取操作把素材的存储分析与时间线上的每次使用关联起来。在受控实验中,一个真实模型在 277 次自身已提交编辑被破坏后重新处理:无论完整反馈还是最小反馈,它几乎修正了每一次调用,但定位每个问题使一次修正所需的输入 token 降至不足一半,且其修正在一例中丢弃了模型写入的其他值,而非七例。

关键要点

  1. 01现有视频编辑智能体依赖评审智能体、审核器或受限输出格式来保证编辑有效。
  2. 02接口仅含一个读取工具与一个写入工具,写入经统一执行器、规则与提交服务,原子提交或被拒并给出定位诊断。
  3. 03读取操作将素材的存储分析与时间线上的每次使用关联。
  4. 04277 次被破坏的已提交编辑中,模型几乎全部修正;定位问题使修正所需输入 token 降至不足一半。
  5. 05修正时在一例中丢弃了模型写入的其他值,而非七例。

解读

尚无解读。

原始英文摘要

arXiv:2610.37690v1 Announce Type: cross Abstract: Language agents increasingly work by calling tools on a persistent artifact, such as a code repository, and the result of each call shapes their next step. Video editing is a demanding case of this pattern: what a frame shows depends on how every clip is trimmed, retimed, cropped, and nested, so knowledge about the footage holds only for particular uses of it, and an invalid edit can leave the timeline structurally broken. Existing video editing agents keep their edits valid with critic agents, reviewers, or restricted output formats. We present Cassette-Editor, a video editing agent with a deliberately simple interface: one tool reads the project and one tool writes to it. Every write passes through the same executor, rules, and commit service as the user's manual edits, and either commits atomically or is rejected with located diagnostics and repair options, while the model keeps the creative choices and decides how to recover. Reads relate stored analysis of the footage to each use of it on the timeline. In a controlled experiment, a real model is shown 277 of its own committed edits after damaging them. It corrected nearly every call with full or minimal feedback, but locating each problem cut the input tokens a correction needed to less than half, and its corrections dropped other values the model had written in one case rather than seven.

同方向论文 · cs.MM

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 2

音频github.com/f/awesome-chatgpt-prompts·外部收录·

Podcast Guest Booker

- Know the podcast topic and past guests. - Find 5 potential guests a week: people recently in the news or with new work in the niche. - Research each and write a short, specific invite. - When someone accepts, propose recording slots from …

视频github.com/f/awesome-chatgpt-prompts·外部收录·

YouTube Video Downloader Skill

--- name: youtube-video-downloader-skill description: Helps download YouTube videos. Asks for the video URL and preferred quality, then outlines the steps and tools to fetch the video safely. --- # YouTube Video Downloader Skill Download …