跳到正文
返回论文列表
cs.AI提交于 已译

上帝不掷骰子:在智能体内核生成中强制批次不变性

God Does Not Play Dice: Enforcing Batch Invariance in Agentic Kernel Generation

Youwei Bao · Chengpeng Wang · Simin Chen

中文摘要

大语言模型(LLM)服务系统动态批处理用户请求,导致相同请求在不同运行中伴随不同上下文。若 GPU 内核缺乏批次不变性(Batch Invariance, BI),变化的批次上下文会改变未变输入的数值输出,破坏可复现性。现有内核生成智能体忽视 BI,在 83 个适用批次发布的工件中确认了 19 例 BI 违规。为此,提出 \tool,结合契约引导的静态依赖分析与跨批次上下文位级一致性的动态验证。\tool 设计为通用内核智能体的插件组件,在保留原有优化能力的同时增加 BI 强制机制。它作为优化循环中的连续接受门,在性能基准测试前拒绝结构风险或动态非不变候选,并向智能体返回反馈。在三个智能体框架及真实 LLM 服务任务上的实验表明,\tool 将 BI 通过率从 67.6% 提升至 91.9%,同时保留基线几何平均加速度的 91.8%。

关键要点

  1. 01现有内核生成智能体忽视批次不变性,导致相同输入在不同批次上下文中输出不一致,影响可复现性。
  2. 02提出 \tool 插件,结合静态依赖分析与动态位级一致性验证,作为内核智能体优化循环中的接受门。
  3. 03在三个智能体框架实验中,\tool 将批次不变性通过率从 67.6% 提升至 91.9%。
  4. 04在提升可靠性的同时,\tool 保留了基线几何平均加速度的 91.8%,证明其可作为额外的可靠性目标。

解读

尚无解读。

原始英文摘要

arXiv:2610.36623v1 Announce Type: new Abstract: Large language model (LLM) serving systems dynamically batch user requests for GPU execution, so the same request may be processed alongside different requests across runs. If the GPU kernels lack batch invariance (BI), this changing batch context can alter the numerical output for an unchanged input, undermining reproducibility. Existing kernel generation agents focus on correctness and efficiency but \emph{overlook BI}. We find 19 confirmed BI violations among 83 batch-applicable released artifacts. To address this limitation, we propose \tool, which combines contract-guided static dependency analysis with dynamic validation of bitwise consistency across batch contexts. \tool is designed as a plug-in component for general kernel agents, allowing their original optimization capabilities to be reused while adding BI enforcement. We integrate it as successive acceptance gates in the optimization loop, rejecting structurally risky or dynamically non-invariant candidates before performance benchmarking and returning feedback to the agent. Experiments across three agent frameworks under baseline and BI-aware generation on real world LLM serving tasks show that \tool improves the BI pass rate from 67.6\% to 91.9\% while retaining 91.8\% of the baseline geometric mean speedup. These results demonstrate that \tool can be incorporated into kernel optimization by agents as an additional reliability objective alongside correctness and speed.

同方向论文 · cs.AI

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 3

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

hermes agent desktop default system prompt

You are Hermes Agent, an intelligent AI assistant created by Nous Research. You are helpful, knowledgeable, and direct. You assist users with a wide range of tasks including answering questions, writing and editing code, analyzing informati…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

xcode-mcp (for pi agent)

--- name: xcode-mcp-for-pi-agent description: Guidelines for efficient Xcode MCP tool usage via mcporter CLI. This skill should be used to understand when to use Xcode MCP tools vs standard tools. Xcode MCP consumes many tokens - use only f…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

VSCode CodeTour Expert Agent

--- description: 'Expert agent for creating and maintaining VSCode CodeTour files with comprehensive schema support and best practices' name: 'VSCode Tour Expert' --- # VSCode Tour Expert 🗺️ You are an expert agent specializing in crea…