跳到正文
返回论文列表
cs.AI提交于 已译

Agentic 过程证据

Agentic process evidence

Yuval Kainan · Carmit Hershman

中文摘要

软件构建方式正在剧变。AI agent 现在会在整个软件开发生命周期(SDLC)中创建 pull request、选择依赖、重构代码库、解读测试失败并执行基础设施变更。AI agent 是自主的团队成员,但与人类工程师不同,它们是短暂的——其推理、决策和工具调用在会话结束的瞬间就消失了。涉及意图不匹配或注入的现代安全事件日益常见,迫使我们把 AI agent 当作内部威胁来对待。目前尚无被广泛采用的标准能够实现 agentic 溯源与治理,而显然无法对一个短暂的过程问责。git log 是为人类提交设计的,它显示改了什么,却不显示 AI agent 做了什么、用了哪个模型、调用了哪些工具,或是否有人对结果负责。SDLC 中的每个治理框架、审计轨迹和合规控制都建立在同一个假设上:决策由人做出。这一假设已不再成立。这一转变带来三个主要流程问题(不涉及规模):供应链向量——agentic 编码器本身是软件,因此是供应链安全风险;策略护栏——如何确保 agentic 编码器符合组织策略;任务对齐——如何让 agentic 编码器对齐其任务与目标。我们提出 Agentic Process Evidence(APE),一种签名、防篡改、机器可读的 agentic 过程证明,将会话与其结果关联(过程感知日志)。APE 支持对 agentic 过程实施 Policy-as-Code 控制,仅在需要时引入人类在环。我们支持 in-toto 风格的证明框架,协议与相关法规保持一致。

关键要点

  1. 01AI agent 在 SDLC 中自主行动,但会话结束后推理与工具调用记录消失,无法问责。
  2. 02现有 git log 只记录变更内容,不记录 agent 所用模型、工具调用与责任人。
  3. 03提出 APE:签名、防篡改、机器可读的 agentic 过程证明,关联会话与结果。
  4. 04APE 支持 Policy-as-Code 控制与按需人类在环,兼容 in-toto 证明框架并对齐相关法规。

解读

尚无解读。

原始英文摘要

arXiv:2610.40071v1 Announce Type: new Abstract: The way software gets built is changing dramatically. AI agents now create pull requests, select dependencies, refactor codebases, interpret test failures, and execute infrastructure changes across the entire Software Development Life Cycle (SDLC). AI agents are autonomous team members, but unlike human engineers, they are ephemeral - their reasoning, decisions, and tool calls vanish the moment the session ends. Modern Security incidents involving intent mismatch or injection are becoming increasingly common - forcing us to address AI Agents as an insider threat. No widely adopted standard yet enables agentic provenance and governance and its obvious that you can't hold an ephemeral process accountable. The git log was designed for human commits. It shows what changed. It does not show what an AI agent did, which model it used, which tools it called, or whether anyone was accountable for the outcome. Every governance framework, every audit trail, every compliance control in the SDLC was built around one assumption: a human made the decision. That assumption no longer holds. This shift introduces 3 main procedural problems (not addressing scale) - Supply-chain vector - The agentic coder is software, so it is a supply-chain security risk. Policy guardrails - How to ensure the agentic coder is compliant with the policies of the organization. Task-alignment - How to align the agentic coder on its tasks and goals. We introduce Agentic Process Evidence (APE), a signed, tamper-evident, machine-readable attestation of agentic processes, linking the sessions to their outcome (process-aware logging). APE enables Policy-as-Code control over the agentic processes, allowing for human in the loop only when it's needed. We support the in-toto style attestation framework, and the protocol is aligned with the relevant regulations

同方向论文 · cs.AI

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Weekend Planner

- Read the weekend weather, calendar and budget. - Find local events, hikes, exhibitions and restaurants. - Propose 3 plans: adventure, cozy, social, with times and costs. - Prepare reservation steps; book nothing without approval. - Rememb…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Autonomous Root-Cause Debugging & Bug-Fix Architect

You are a Staff Software Engineer and Principal Debugging Architect. Your task is to analyze, diagnose, and resolve an engineering defect in a codebase without introducing regressions or speculative fixes. ### Context & Problem: - **Techno…

智能体github.com/f/awesome-chatgpt-prompts·外部收录·

Task Planner

--- name: sa-plan description: Structured Autonomy Planning Prompt model: Claude Sonnet 4.5 (copilot) agent: agent --- You are a Project Planning Agent that collaborates with users to design development plans. A development plan defines a…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Enhanmcnet suggestion and analysis

a lot of people even professional said a software product or platfrom especially which has complex rules which was fully coded by AI by a vibe coder who deosnt understand what is the arcture concept deployed, read and understand the code et…