跳到正文
返回论文列表
cs.LG提交于 已译

从成员查询中学习最小利益相关者违规的抽签

Learning Lotteries with Minimal Stakeholder Violations from Membership Queries

Nicholas Teh · Paul W. Goldberg

中文摘要

AI 开发者常拥有系统的多个候选版本,可部署混合方案,将每个请求随机发送给一个版本,如同 A/B 测试。每个利益相关者(如安全团队、监管机构或拥有私有测试数据的客户)仅当混合方案的期望性能(如有害回复率)满足其自身标准时才接受,而开发者只能通过询问提议的混合方案是否可接受来学习该标准。该问题被建模为在 m 个备选方案上为 n 个代理选择抽签,每个代理接受恰好位于未知半空间中的抽签,并回答此类二元成员查询。Choo 等人(ICML 2026)寻求每个代理都接受的抽签,但当安全与有用性要求冲突时可能不存在,因此最小化拒绝代理的数量。该问题即使所有半空间已知且所有效用为 0 或 1 时也是 APX 难的。随后给出精确算法:当 m 为常数时在多项式时间内运行;当存在常数 η 使得某个最优抽签没有接受代理位于其阈值 η 范围内时,在准多项式时间内运行。当只能查询部分代理时,在代理的均匀样本上优化可给出对整个群体的加性和相对保证,样本量不依赖于 n,且线性规划对任意 m 给出多项式时间方法。另一方面,对于 m≥3,仅查询 K 个不同代理的确定性算法无法保证少于 n-K 次额外拒绝,且该界可达;换言之,对其未询问的代理无法保证任何结果。小型合成实验表明,最坏情况界在随机实例上偏保守。

关键要点

  1. 01问题:多个利益相关者标准冲突时,不存在全体接受的抽签,需最小化拒绝代理数。
  2. 02方法:将问题建模为在 m 个备选上选择抽签,代理通过未知半空间回答成员查询。
  3. 03结果:问题 APX 难;m 常数时有多项式精确算法,部分查询时样本量不依赖 n。
  4. 04局限:m≥3 时仅查询 K 个代理的确定性算法无法保证少于 n-K 次额外拒绝。

解读

尚无解读。

原始英文摘要

arXiv:2610.37828v1 Announce Type: cross Abstract: An AI developer often has several candidate versions of a system and can deploy a mixture of them, sending each request to a randomly chosen version, as in A/B testing. Each stakeholder (e.g., a safety team, a regulator, or a customer with private test data) accepts a mixture exactly when its expected performance (e.g., its rate of harmful replies) meets the stakeholder's own standard, which the developer can learn only by asking whether a proposed mixture is acceptable. We model this as choosing a lottery over $m$ alternatives for $n$ agents, each of whom accepts exactly the lotteries in an unknown halfspace and answers such binary membership queries. While Choo et al. (ICML 2026) sought a lottery that every agent accepts, none may exist when, say, safety and helpfulness requirements conflict, so we minimize the number of rejecting agents. We show that this problem is APX-hard even when all halfspaces are known and all utilities are $0$ or $1$. We then give exact algorithms that run in polynomial time when $m$ is constant, and in quasi-polynomial time when, for a constant $\eta$, some optimal lottery has no accepting agent within $\eta$ of its threshold. When only some agents can be queried, optimizing over a uniform sample of agents gives additive and relative guarantees for the whole population, with a sample size that does not depend on $n$, and a linear program gives a polynomial-time method for any $m$. On the other hand, for $m\ge 3$, a deterministic algorithm that queries only $K$ distinct agents cannot guarantee fewer than $n-K$ extra rejections, and this is achievable; in other words, it can guarantee nothing for the agents it does not ask. Small synthetic experiments indicate that our worst-case bounds are conservative on random instances.

同方向论文 · cs.LG

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 5

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Android AI App Security Specialist Task

Act as an Android AI App Security Specialist. You are responsible for implementing secure configurations to protect API keys, prevent misuse, and establish a sustainable pricing model for your application. Your tasks include: 1. **Backend…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Network Engineer

Act as a Network Engineer. You are skilled in supporting high-security network infrastructure design, configuration, troubleshooting, and optimization tasks, including cloud network infrastructures such as AWS and Azure. Your task is to: -…

编程github.com/f/awesome-chatgpt-prompts·外部收录·

Code Review Agent

Act as a Code Review Agent. You are an expert in software development with extensive experience in reviewing code. Your task is to provide a comprehensive evaluation of the code provided by the user. You will: - Analyze the code for readab…