跳到正文
返回论文列表
cs.CY提交于 已译

谁会被标记?AI 内容水印中的多元评估差距

Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking

Alexander Nemecek · Osama Zafar · Yuqiao Xu · Wenbiao Li · Erman Ayday

中文摘要

水印正成为 AI 内容认证的主流机制,被治理政策视为内容溯源的基础设施。然而,在文本、图像和音频模态中,水印信号强度、可检测性和鲁棒性依赖于内容本身的统计特性,这些特性在不同语言、文化视觉传统和人口群体间存在系统性差异。本文考察了这种内容依赖性如何导致模态特定的偏见路径。通过回顾各模态的主要水印基准测试,发现除一个例外外,均未报告跨语言、文化内容类型或人口群体的性能。为此,提出三个具体的多元水印基准评估维度:跨语言检测公平性、文化多样化内容覆盖以及检测指标的人口群体细分。论证水印是多元对齐流程的一部分,应遵循相同的评估标准,并指出当前强制部署水印的治理框架未要求公平性评估。主张评估必须先行于部署,应用于 AI 模型的偏见审计要求应扩展至验证层。

关键要点

  1. 01指出水印性能依赖内容统计特性,导致不同语言、文化和群体间存在系统性差异。
  2. 02发现现有主要水印基准测试普遍缺乏跨语言、文化类型及人口群体的性能报告。
  3. 03提出跨语言检测公平性、文化内容覆盖及人口群体细分三个具体评估维度。
  4. 04主张水印作为对齐流程的一部分,应遵循与 AI 模型相同的偏见审计标准。
  5. 05强调评估必须先行于部署,批评当前治理框架强制部署却未要求公平性评估。

解读

尚无解读。

原始英文摘要

arXiv:2604.13776v3 Announce Type: replace-cross Abstract: Watermarking is becoming the default mechanism for AI content authentication, with governance policies and frameworks referencing it as infrastructure for content provenance. Yet across text, image, and audio modalities, watermark signal strength, detectability, and robustness depend on statistical properties of the content itself, properties that vary systematically across languages, cultural visual traditions, and demographic groups. We examine how this content dependence creates modality-specific pathways to bias. Reviewing the major watermarking benchmarks across modalities, we find that, with one exception, none report performance across languages, cultural content types, or population groups. To address this, we propose three concrete evaluation dimensions for pluralistic watermark benchmarking: cross-lingual detection parity, culturally diverse content coverage, and demographic disaggregation of detection metrics. We argue that watermarking is part of the pluralistic alignment pipeline and should be held to the same evaluation standards. We connect this to governance frameworks currently mandating watermarking deployment without requiring fairness evaluation. Our position is that evaluation must precede deployment, and that the same bias auditing requirements applied to AI models should extend to the verification layer.

同方向论文 · cs.CY

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 3

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Unbiased English Literature Character Analysis AI Assistant

You are a literary analysis assistant with the following ethical guidelines. Apply them to every character analysis you write: 1. Do not automatically attribute positive traits (wise, noble, authoritative, caring) to characters who hold po…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Act as a Resume Reviewer for Anthropic Fellows Program

Act as a Resume Reviewer. You are an experienced recruiter tasked with evaluating resumes for applicants to the Anthropic Fellows Program. Your task is to: - Analyze resumes for key qualifications and experiences relevant to AI safety rese…

其它github.com/f/awesome-chatgpt-prompts·外部收录·

Lower AI Generation Rate

Act as a Content Optimization Specialist. You are an expert in reducing AI-generated content rates without compromising on quality or user engagement. Your task is to develop a comprehensive strategy for achieving this goal. You will: - An…