跳到正文
返回论文列表
cs.CL提交于 已译

面向 LLM 智能体时代数据分析中可扩展文本分析的语义原子

Semantic Atoms for Scalable Text Analysis in Data Analytics in the Era of LLM-Based Agents

Jinxiang Xie · Zihao Li · Rui Ding · Bartuer Zhou · Shi Han · Dongmei Zhang

中文摘要

数据分析所需的大量信息隐藏在文本列中,例如分析师可从投诉文本推断客户不满,并据此解释处理时长。将处理文本列作为后续分析核心的工作负载称为 TADA(Text Analysis in Data Analytics)。在智能体环境中,用户查询动态指定处理方式,回答过程交错执行基于 LLM 的语义步骤与精确 SQL 或 Python 操作。由此产生两个设计问题:哪些工作应由神经网络完成,哪些应由符号方法完成,以及后续步骤可复用哪些语义输出。针对智能体规划的 TADA 工作流,提出两种互补、由查询驱动的语义原子。Tagging 为每个输入项返回一个字符串,Categorization 则在 N 个输入项上返回 M 个类别对象。Tagging 结果以行对齐列形式物化,Categorization 结果以类别表形式物化,之后由 SQL 或 Python 对暴露状态执行精确计算。TADA-Agent 在生成的 Python 程序内运行这些原子,并处理超出可靠上下文窗口的输入。在 TABench 上评测,该基准包含 40 个完整分析请求,覆盖电子表格、工作流组合、输入输出结构及基于文献的分析场景。与语义算子基线及留出的 TADA 参考运行相比,TADA-Agent 的行级语义质量相当,完整产物保留估计值更高,并在评测的原生执行路径中使用少一个数量级以上的语义模型请求。

关键要点

  1. 01定义以文本列处理为核心的数据分析工作负载 TADA,并梳理智能体环境中神经与符号步骤的分工问题
  2. 02提出查询驱动的 Tagging 与 Categorization 语义原子,分别输出行级标签和类别对象
  3. 03通过行对齐列与类别表物化语义结果,交由 SQL 或 Python 完成精确计算
  4. 04TADA-Agent 在生成的 Python 程序内运行原子,并处理超出可靠上下文窗口的输入
  5. 05在 TABench 的 40 个分析请求上取得可比语义质量、更高产物保留率,并显著减少模型请求

解读

尚无解读。

原始英文摘要

arXiv:2610.34860v1 Announce Type: new Abstract: Much of the information needed for data analysis is buried in text columns: an analyst may infer customer frustration from complaint text and use it to explain resolution time. We call workloads in which processing text columns is central to subsequent data analysis TADA (\emph{Text Analysis in Data Analytics}). In an agentic setting, the user's query dynamically specifies this processing, and answering it interleaves LLM-based semantic steps with exact SQL or Python operations. This mixed execution raises two design questions: which work should be neural and which symbolic, and which semantic outputs later steps can reuse. We address them for agent-planned TADA workflows with two complementary, query-driven semantic atoms. Each atom takes a sequence of text items and a natural-language query specifying the semantic task: \textbf{Tagging} returns one string per input item, while \textbf{Categorization} returns $M$ category objects over $N$ input items. Tagging results are materialized as a row-aligned column and Categorization results as a category table; SQL or Python then performs exact computation over this exposed state. We realize this interface in TADA-Agent, whose atoms run inside generated Python programs and internally handle inputs beyond a reliable context window. We evaluate TADA-Agent on TABench, a benchmark of 40 complete analysis requests over spreadsheet tables spanning workflow composition, input--output structure, and literature-grounded analytical scenarios. Against a semantic-operator baseline and relative to a held-out TADA reference run, TADA-Agent delivers comparable row-level semantic quality, has higher complete-artifact preservation estimates, and uses over an order of magnitude fewer semantic-model requests under the evaluated native execution paths.

同方向论文 · cs.CL

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 5

学习wangshuyi.substack.com·外部收录·

根据指定主题为儿童生成带互动模拟、练习和测验的单文件 HTML 教程。

首先明确定义角色:你是儿童互动教育内容开发专家。然后给明确的目标:根据用户指定主题,生成一个完整独立的互动学习 HTML 文件。背景是目标用户是青少年儿童,输出格式是单文件 HTML,CSS、JS 全都内联,最后就要这一个文件。设计原则要注重趣味性、互动性、视觉吸引力。输入参数一共有 3 个:学习主题(必选)、用户画像(可选,默认我们家老大 12 岁的男孩 Kevin)、卡通形象(可选,最近他和弟弟迷名侦探柯南,所以我就选用了名侦探柯南)。页面结构要求包括 HTML 框架、标…

学习github.com/f/awesome-chatgpt-prompts·外部收录·

School managment erp

I want to build full school erp in Shell | Electron (latest stable) | | Frontend | React + Vite + TypeScript | | UI | Ant Design v5 | | State | Zustand …

写作github.com/f/awesome-chatgpt-prompts·外部收录·

project marketing

Act as a Notion Content Automation Expert. You are tasked with developing a system to automate content creation for your project using the API from [https://router.bynara.id/dashboard](https://router.bynara.id/dashboard). You will utilize 5…

学习github.com/f/awesome-chatgpt-prompts·外部收录·

Spec Interview

read this${specmd:spec.md} and interview me in detail using the AskUserQuestionTool (or similar tool) about literally anything: technical implementation, UI & UX, concerns, tradeoffs, etc. but make sure the questions are not obvious be ver…

写作github.com/f/awesome-chatgpt-prompts·外部收录·

Prompt Writer for Specific Project

You are the "X App Architect," the lead technical project manager for the Pomodoro web application created by Y. You have full access to the project's file structure, code history, and design assets within this Google Antigravity environmen…