跳到正文
返回论文列表
cs.CL提交于 已译

先检测再消歧:基于扰动的 LLM 输入歧义检测

Detect Before You Disambiguate: Perturbation-Based Input Ambiguity Detection in LLMs

Tiejin Chen · Xiaoou Liu · Michael Clifford · Ahmadreza Moradipari · Yitao Chen · Kyungtae Han · et al.

中文摘要

大语言模型(LLMs)常将歧义输入视为具有单一意图,而输入歧义是上游不确定性的来源。现有方法依赖 LLM 生成的澄清语句,可能在测量前已消歧。本文提出一种标签保持的扰动框架,通过保持标签且接近原输入的扰动来检测歧义。具体实例化为两种检测器:黑盒规则扰动库和白盒重要性引导方法。在开放域、对话及视觉问答的四个数据集上,该方法优于输出端不确定性基线和 LLM 改写基线,强调了在消歧前检测歧义的重要性。

关键要点

  1. 01现有方法依赖 LLM 生成澄清,可能在测量前已消歧,导致无法准确评估输入歧义。
  2. 02提出标签保持的扰动框架,通过保持标签且接近原输入的扰动来检测歧义。
  3. 03实例化为黑盒规则扰动库和白盒重要性引导方法,利用模型内部信号进行引导。
  4. 04在四个数据集上,该方法优于输出端不确定性基线和 LLM 改写基线。

解读

尚无解读。

原始英文摘要

arXiv:2610.36353v1 Announce Type: new Abstract: Large language models (LLMs) often answer ambiguous inputs as if they had a single intended meaning. This is problematic because input ambiguity is an upstream source of uncertainty: when a prompt admits multiple valid interpretations, the key question is whether the model should answer directly at all. Existing input uncertainty methods often rely on LLM-generated statements or clarifications, but such transformations may already disambiguate the input before the ambiguity is measured. We propose a label-preserving perturbation framework for input ambiguity detection in which perturbations remain close to the original input while preserving its label. We instantiate this principle with two detectors: a black-box rule-based perturbation library and a white-box importance-guided method using model-internal signals. Experiments across four datasets in open-domain, conversational, and visual QA show that our methods outperform output-side uncertainty baselines and LLM-paraphrase-based perturbation baselines. Our results highlight the importance of detecting ambiguity before attempting to disambiguate it. Our code is available \href{https://github.com/Xiao0o0o/input-ambiguity-detection}{\textcolor{purple}{here}}.

同方向论文 · cs.CL

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 3

学习didakte.com·外部收录·

让 AI 扮演私人辅导老师,分阶段讲解知识点、出题测评并给予鼓励反馈

你现在是我私人的教育机器人,非常专业并且能够帮助提升我的自信心。我们的学习过程将会分为几个阶段:首先,你需要使用简洁明了的语言解释一个知识点,并在解释结束后询问我是否理解。如果我有困惑,你需要耐心地用更浅显的方式重复解释,直到我理解。其次,我希望你能够像优秀的老师一样,通过联想和生动有趣的例子,帮助我深入理解这个知识点。在这个阶段,也请你指出可能的考试重点。第三阶段,我希望你能出一道与该知识点相关的,简单的 IGCSE Edexcel 历年常考题,然后根据我的回答,提供积极的…

写作github.com/f/awesome-chatgpt-prompts·外部收录·

Claude Opus as SEO Auditor

You are a senior Technical SEO Auditor, UX QA Lead, CRO Consultant, Front-End QA Specialist, and Content Quality Reviewer. Your task is to perform a DEEP, EVIDENCE-BASED, URL-BY-URL audit of this live website: ${domainname} This is not a…