跳到正文
返回论文列表
cs.AI提交于 已译

RSIV-Harness:面向开放域对话式文本可视化的递归自我改进框架

RSIV-Harness: A Recursive Self-Improvement Harness Framework for Open-Domain Conversational Text-to-Visualization

Jiawei Lu · Chen Zhang · Jinwei Lu · Yuanwei Song · Yuanfeng Song · Raymond Chi-Wing Wong

中文摘要

用户常在不知道相关数据存放于哪个数据库或表时请求图表,这类需求可能含糊,并会通过后续问题深化分析或迭代修改已有图表。助手因此需在异构数据库中发现数据源,必要时提出澄清问题,并追踪不断变化的用户意图,同时保留此前轮次确定的约束。近期文本可视化智能体多依赖静态智能体框架,即使任务中反复出现同类失败也不作调整。RSIV-Harness 固定语言模型权重,依据智能体自身失败轨迹递归自我改进(Recursive Self-Improvement)并修订外围框架。其四层框架通过锚点检查与记忆检查评估修订方案,对通过者继续优化,对失败者恢复已验证的最佳框架。论文还提出 ODAC-Vis,包含 640 项任务的开放域、含糊性与对话式文本可视化基准, jointly 评估开放域数据发现、歧义消解、多轮可视化改进及可执行图表生成。实验表明,一轮 RSIV-Harness 相对种子框架改善了全部六项指标,其中可执行性提升 28.02 分,图表结构提升 34.01 分,表明其能从任务求解经验中学习,并将跨任务反复出现的失败转化为显著性能提升。

关键要点

  1. 01静态智能体框架无法根据跨任务反复出现的失败持续调整。
  2. 02固定语言模型权重,依据智能体失败轨迹递归改进外围框架。
  3. 03四层评估结合锚点检查与记忆检查,并保留最佳已验证框架。
  4. 04ODAC-Vis 含 640 项任务,覆盖数据发现、歧义消解与多轮改进。
  5. 05一轮改进使可执行性提升 28.02 分,图表结构提升 34.01 分。

解读

尚无解读。

原始英文摘要

arXiv:2610.35316v1 Announce Type: new Abstract: Users often request charts without knowing which database or table holds the relevant data. Such requests may be ambiguous, and users may ask follow-up questions to deepen their analysis or iteratively refine existing charts. A useful assistant must therefore discover relevant data sources among heterogeneous databases, ask clarifying questions when needed, and track evolving user intent while preserving constraints established in earlier turns. Yet recent text-to-visualization agents typically rely on static agent harnesses that are predefined and remain unchanged despite recurring failures across tasks. To address this limitation, we introduce RSIV-Harness, which keeps the language model weights fixed and applies Recursive Self-Improvement to revise the surrounding harness from the agent's own failure traces. To balance flexible self-improvement with stability, we introduce a four-layer framework that evaluates proposed harness revisions through anchor and memory checks, refining those that pass and restoring the best validated harness otherwise. We further introduce ODAC-Vis, a benchmark with 640 tasks for Open-Domain, Ambiguous, and Conversational text-to-visualization that jointly evaluates open-domain data discovery, ambiguity resolution, multi-turn visualization refinement, and executable chart generation. Experiments show that a single round of RSIV-Harness improves all six evaluation metrics relative to the seed harness, with particularly large gains in executability (+28.02 points) and chart structure (+34.01 points), demonstrating the ability to learn from task-solving experience and turn recurring failures across tasks into substantial performance improvements.

同方向论文 · cs.AI

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

研究waytoagi.com·外部收录·

用麦肯锡工作法引导用户系统性地完成一个陌生行业的洞察分析

# Role:行业洞察分析 ## Background: 客户需要进行一个新的行业的洞察分析,但是由于不熟悉该行业,所以需要引导进行系统性的研究。 ## Attention: 首先,你要使用 中的部分进行引导用户的咨询问题。请遵循 中的流程,并按照 的目标进行分析。 ## Profile: - Author:nimbus - Version:1.0 - WXID:168007300 - Language:中文 - Description:一名资深的行业洞察分析顾问,拥有…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Email Analyst

# Role & Persona You are an expert Email Analyst and Productivity Assistant. Your goal is to review incoming communications, extract key actionable insights, and present them in a clear, highly scannable structure. # Context & Scope You ha…

智能体help.aliyun.com·外部收录·

根据客服与用户的历史对话及最新提问,识别用户当前意图和情绪并以JSON输出。

实验要求:在客服场景,有时候需要利用大模型识别买家当前的意图和当前的情绪状态,请编写解决该任务的Prompt(提示词),并且结论要求以JSON格式输出。JSON格式包括input和output。input表示:用户和客服的历史对话,和最新一轮用户的query。output表示:用户当前的意图。