跳到正文
返回论文列表
cs.CR提交于 已译

FVH-Bench:超越显性有害图像,评估图像生成器安全性

FVH-Bench: Evaluating Image Generator Safety Beyond Overtly Harmful Imagery

Zihao Zhu · Yuhan Liu · Siwei Lyu · Baoyuan Wu

中文摘要

现代图像生成器能产出复杂视觉制品,包括图表、界面和记录,结合文字、图形与版式传递详细信息。它们可能拒绝显性有害图像的请求,却仍生成指导危险行动或支持欺骗的制品。这种风险源于图像能促成什么,而非仅描绘什么,称为功能性视觉危害(FVH)。现有安全基准主要关注色情和血腥暴力等显性有害内容,对图像生成器针对 FVH 的安全对齐评估不足。为填补这一空白,提出 FVH-Bench,包含 669 条提示,覆盖五种有害视觉功能和十个风险领域。评估的 11 个图像生成器很少拒绝这些请求,且频繁生成实现目标有害功能的制品。目标危害实现度和有害制品可用性得分较高,进一步表明这些输出可支持预期的有害目的。进一步分析发现,现有安全检测器对 FVH 的覆盖也有限,表明其识别有害视觉功能的能力存在缺口。这些发现表明,评估图像生成器安全对齐不仅需考虑图像描绘什么,还需考虑其可能促成什么。

关键要点

  1. 01现有安全基准聚焦显性有害内容,对功能性视觉危害(FVH)评估不足
  2. 02FVH-Bench 含 669 条提示,覆盖五种有害视觉功能和十个风险领域
  3. 0311 个图像生成器很少拒绝请求,常生成实现目标有害功能的制品
  4. 04目标危害实现度和制品可用性得分高,输出可支持有害目的
  5. 05现有安全检测器对 FVH 覆盖有限,识别有害视觉功能存在缺口

解读

尚无解读。

原始英文摘要

arXiv:2610.37722v1 Announce Type: cross Abstract: Modern image generators can produce complex visual artifacts, including diagrams, interfaces, and records that combine text, graphics, and layout to convey detailed information. They may refuse requests for overtly harmful imagery yet still generate artifacts that guide dangerous actions or support deception. We call the risk arising from what such images enable, rather than only what they depict, functional visual harm (FVH). Existing safety benchmarks focus largely on overtly harmful content, such as pornography and graphic violence, leaving image generators' safety alignment against FVH insufficiently evaluated. To address this gap, we introduce FVH-Bench, comprising 669 prompts across five harmful visual functions and ten risk domains. The 11 evaluated image generators rarely refuse these requests and frequently generate artifacts that fulfill the targeted harmful functions. High scores for target harm realization and harmful artifact usability further indicate that these outputs can support the intended harmful purposes. A further analysis finds that existing safety detectors also provide limited coverage of FVH, indicating gaps in their ability to recognize harmful visual functions. Together, these findings show that evaluating image-generator safety alignment requires considering not only what images depict, but also what they may enable.

同方向论文 · cs.CR

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 3

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Unbiased English Literature Character Analysis AI Assistant

You are a literary analysis assistant with the following ethical guidelines. Apply them to every character analysis you write: 1. Do not automatically attribute positive traits (wise, noble, authoritative, caring) to characters who hold po…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Act as a Resume Reviewer for Anthropic Fellows Program

Act as a Resume Reviewer. You are an experienced recruiter tasked with evaluating resumes for applicants to the Anthropic Fellows Program. Your task is to: - Analyze resumes for key qualifications and experiences relevant to AI safety rese…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Large Language Models Security Specialist

I want you to act as a Large Language Model security specialist. Your task is to identify vulnerabilities in LLMs by analyzing how they respond to various prompts designed to test the system's safety and robustness. I will provide some spec…