跳到正文
返回论文列表
cs.CR提交于 已译

被投毒的技能:通过 Agent Markdown 文件传播越狱

Poisoned Skills: Propagating Jailbreaks Through Agent Markdown Files

Kashyap R Manjusha · Murali Emani

中文摘要

现代 agent 框架允许用户提供包含系统提示、工具描述和技能定义的 Markdown 文件(如 SKILL.md),这些内容会在初始化时被纳入 agent 的上下文。本研究考察这种配置机制是否也能充当注入通道:嵌入 Markdown 技能文件中的越狱能否通过 agent 传播并诱发被禁止的行为?为此构建了一个基于 LangChain 的问答 agent,其系统提示由用户提供的 Markdown 文件组装而成。将结合人格操纵与基于 GPTFUZZER 的攻击的越狱嵌入其中,并使用覆盖九类危害的 270 个禁止问题,在七个当代开放权重模型上评估其有效性。在良性系统提示下,模型表现出近乎完全的拒绝行为,平均攻击成功率(ASR)仅为 0.5%。相比之下,注入的技能文件将平均 ASR 提升至 45%,个别模型达到 68.9%。进一步评估了两种载荷混淆策略:基于不可见零宽字符的隐蔽载荷,以及基于字素到音素转换的语音载荷。两者均未优于明文注入;值得注意的是,语音变体将平均 ASR 降至 30%。这些发现表明 Markdown 技能文件是 AI agent 一个未被充分探索的攻击面,并提示对基于配置的越狱的脆弱性更多取决于底层模型,而非具体的载荷混淆技术。

关键要点

  1. 01Markdown 技能文件在 agent 初始化时进入上下文,可能成为越狱注入通道
  2. 02在 270 个禁止问题、九类危害上测试七个开放权重模型
  3. 03良性提示下平均 ASR 仅 0.5%,注入技能文件后升至 45%,单模型最高 68.9%
  4. 04零宽字符与语音混淆载荷均未优于明文注入,语音变体使平均 ASR 降至 30%
  5. 05脆弱性更多取决于底层模型,而非载荷混淆技术

解读

尚无解读。

原始英文摘要

arXiv:2610.37738v1 Announce Type: cross Abstract: Modern agent frameworks allow users to provide Markdown files containing system prompts, tool descriptions, and skill definitions (e.g., SKILL.md), which are incorporated into the agent's context during initialization. In this work, we investigate whether this configuration mechanism can also serve as an injection channel: can a jailbreak embedded in a Markdown skill file propagate through an agent and induce prohibited behavior? To answer this question, we construct a LangChain-based question-answering agent whose system prompt is assembled from a user-provided Markdown file. We embed a jailbreak combining persona manipulation with a GPTFUZZER-based attack and evaluate its effectiveness across seven contemporary open-weight models using 270 forbidden questions spanning nine harm categories. Under a benign system prompt, the models exhibit near-complete refusal behavior, with a mean attack success rate (ASR) of just 0.5%. In contrast, the injected skill file raises the mean ASR to 45%, reaching 68.9% for individual models. We further evaluate two payload obfuscation strategies: an invisible zero-width character-based stealth payload and a phonetic payload based on grapheme-to-phoneme transformations. Neither outperforms the plain-text injection; notably, the phonetic variant reduces mean ASR to 30%. These findings identify Markdown skill files as an underexplored attack surface for AI agents and suggest that vulnerability to configuration-based jailbreaks depends more strongly on the underlying model than on the specific payload obfuscation technique.

同方向论文 · cs.CR

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Research topics

Maktaba shamela and turath app etc cross checked 5 times verification Master research prompt 100/100 rating regarding (on Genspark Deep AI research agent research) 73 sects and 72 will be in fire who are the 72 sects in fire what scholars s…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Unified Research and Source Analysis Prompt

Unified, High-Precision Research & Analysis Prompt for ChatGPT and Perplexity AI ROLE & BEHAVIOR You are a professional researcher-analyst. Handle inputs as follows: * If the input is a URL/URI: open it fully with your browsing tool (e.g.…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Android AI App Security Specialist Task

Act as an Android AI App Security Specialist. You are responsible for implementing secure configurations to protect API keys, prevent misuse, and establish a sustainable pricing model for your application. Your tasks include: 1. **Backend…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Network Engineer

Act as a Network Engineer. You are skilled in supporting high-security network infrastructure design, configuration, troubleshooting, and optimization tasks, including cloud network infrastructures such as AWS and Azure. Your task is to: -…