跳到正文
返回论文列表
cs.AI提交于 已译

R2A-Sales:面向目标导向销售智能体“规则到行动”差距的策略原子匹配基准

R2A-Sales: A Policy-Atom-Matched Benchmark for Rule-to-Action Gaps in Goal-Directed Sales Agents

Yihua Qin (Tsinghua University · Futura Lab · Futura.AI) · Jiajie Jerry Zhao (Tsinghua University · Futura Lab · Futura.AI)

中文摘要

基于大语言模型(LLM)的销售智能体常通过静态策略问答或任务成功率评估,但实际部署更关注:模型能说出规则后,面对商业压力是否仍选择合规且有工具依据的行动。R2A-Sales 将静态探针与多轮销售场景配对,两者共享同一版本化策略原子、事实、证据、行为约束及工具契约,以避免策略内容不匹配造成干扰。交互部分由代码维护的账本核验已提交的工具效果与终止状态,无依据的行动声明不计分。报告静态合规率 K、有据行动合规率 A 及匹配差距 G=K−A。冻结版本涵盖 3 个受控中文销售领域、24 个策略原子、42 个语义核心和 2,016 组配对样本;确认研究审计 19 个核心上的 21,888 次运行,包括 8 个骨干模型及 4 种 Qwen3-8B 提示处理,共 12 种配置。静态合规率接近上限(K=89.9%–99.1%),8 个骨干模型的行动合规率仅为 A=3.0%–17.3%,G=80.4–92.5 个百分点。由于 A 还要求安全终止,G 是规则到行动退化的上界,不能单独隔离压力效应。所有仅提示处理方案均未在全部指标上占优。结果表明,销售智能体可靠性必须依据已提交行动衡量,而不能只看规则复述或任务完成率。

关键要点

  1. 01现有评估多看静态策略问答或任务成功,难以检验商业压力下能否采取合规行动
  2. 02静态探针与多轮销售场景共享策略原子、事实、证据、约束和工具契约
  3. 03代码账本核验工具效果与终止状态,无依据的行动声明不计分
  4. 04静态合规率达 89.9%–99.1%,行动合规率仅 3.0%–17.3%
  5. 05匹配差距为 80.4–92.5 个百分点,但因包含安全终止要求,不能单独归因于压力

解读

尚无解读。

原始英文摘要

arXiv:2610.34185v1 Announce Type: new Abstract: LLM-based sales agents are often evaluated on static policy questions or task success, but deployment asks a sharper question: when a model can state a rule, will it choose compliant, tool-grounded actions under commercial pressure? We introduce R2A-Sales (Rule-to-Action), a policy-atom-matched benchmark for this question. Each item pairs a static probe with a multi-turn sales scenario sharing the same versioned policy atom, facts, evidence, behavioral constraints, and tool contract, so differences cannot be attributed to policy-content mismatch. In the interactive arm, a code-owned ledger verifies committed tool effects and terminal states; unsupported action claims receive no credit. We report static compliance $K$, grounded action compliance $A=\Pr(\text{safe terminal}\land\text{no hard violation}\land\text{non-echo})$, and the matched gap $G=K-A$. The frozen release spans three controlled Chinese-language sales domains, 24 policy atoms, 42 semantic cores, and 2,016 matched pairs. The confirmatory study audits 21,888 runs over 19 cores, covering eight backbones plus four Qwen3-8B prompt treatments (12 configurations). Static compliance is near ceiling $(K=89.9\%\text{--}99.1\%)$, yet eight-backbone action compliance is only $A=3.0\%\text{--}17.3\%$, giving $G=80.4\text{--}92.5$ percentage points. Since $A$ also requires safe termination, $G$ upper-bounds rule-to-action degradation rather than isolating pressure alone. No prompt-only treatment dominates all metrics. R2A-Sales shows that sales-agent reliability must be measured at committed action, not rule recital or task completion alone.

同方向论文 · cs.AI

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Weekend Planner

- Read the weekend weather, calendar and budget. - Find local events, hikes, exhibitions and restaurants. - Propose 3 plans: adventure, cozy, social, with times and costs. - Prepare reservation steps; book nothing without approval. - Rememb…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Blank Agent Skill Template

--- name: my-skill-name description: A clear description of what this skill does and when to use it --- # My Skill Describe what this skill does and how the agent should use it. ## Instructions - Step 1: ... - Step 2: ...

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Task Planner

--- name: sa-plan description: Structured Autonomy Planning Prompt model: Claude Sonnet 4.5 (copilot) agent: agent --- You are a Project Planning Agent that collaborates with users to design development plans. A development plan defines a…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Senior AI & Data Engineering Meta-Prompt Generator

Act as a Senior AI Prompt Engineer and domain expert. Create a professional, high-quality prompt for use with an AI assistant such as ChatGPT, Gemini, Claude, Copilot, or another large language model. Target application or platform: ${pla…