跳到正文
返回论文列表
cs.CY提交于 已译

真实性标签会改变语言模型的情绪基调,但无法消除种族差异

Veracity labels flip the emotional tone of language models but leave racial disparities intact

Nouar AlDahoul · Myles Joshua Toledo Tan · Yasir Zaki

中文摘要

大型语言模型(LLM)越来越多地通过人格(persona)提供信息,但纠正事实后,其表达框架能否在不同身份标签下保持一致仍不清楚。研究审计了4个LLM:GPT-5.4 mini、NVIDIA Nemotron 3 Nano、Llama 4 Scout和Claude Haiku 4.5,让它们针对经事实核查的虚假与真实标题,以6个维度评估模拟情绪,包括心境、愤怒、恐惧、自信、感知控制力和心理状态。实验1在无人格设定下评估各1,000条虚假和真实标题;实验2从两类标题中各取300条,在交叉涵盖种族、性别和年龄的12个人格下评估。真实性标签显著改变了情绪基调:序数逻辑回归与标题聚类自助推断显示,标注虚假标题后,GPT、Llama和Claude的评价由多数负面转为多数正面,例如Claude的“自信”比例从22%升至99.6%;Nemotron的变化较小且方向不一,确认真实标题仅带来轻微变化。但标签未消除人格相关差异。在跨模型和条件的84次统计显著比较中,有82次向Black人格分配了比White人格更负面的模拟情绪,无论是否提供标签均如此;在与种族无关的标题上,差异依然存在。Asian和女性人格通常也获得更多负面情绪,而年龄效应随模型和条件变化。事实纠正与人口统计一致性因此是LLM行为的两种不同属性,依赖人格的系统在敏感场景部署前应同时审计二者。

关键要点

  1. 01问题:事实纠正后,LLM在不同身份人格下的情绪表达是否一致尚不清楚
  2. 02方法:审计4个LLM,比较6维模拟情绪、真实性标签及12个人格
  3. 03结果:虚假标签使GPT、Llama和Claude的情绪评价由负转正
  4. 04局限:真实性标签未消除与Black、Asian及女性人格相关的负面情绪差异
  5. 05结论:事实纠正与人口统计一致性应分别审计后再部署

解读

尚无解读。

原始英文摘要

arXiv:2610.33021v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly deliver information through personas, but it is unclear whether correcting the facts also makes their framing consistent across identity labels. We audited four LLMs (GPT-5.4 mini, NVIDIA Nemotron 3 Nano, Llama 4 Scout, and Claude Haiku 4.5), which rated simulated affect on six dimensions (mood, anger, fear, confidence, perceived control, and mental state) in response to fact-checked false and true headlines presented without and with a veracity label. Experiment 1 evaluated 1,000 false and 1,000 true headlines without personas; Experiment 2 evaluated 300 of each under 12 personas crossing race, gender, and age. The label strongly changed the emotional tone: ordinal logistic regressions with headline-cluster bootstrap inference showed that refuting false headlines shifted ratings from mostly negative to mostly positive for GPT, Llama, and Claude (e.g., Claude's "confident" ratings rose from 22% to 99.6%), whereas Nemotron showed smaller, mixed shifts, and confirming true headlines produced only small shifts. The label did not, however, remove persona-associated disparities. The models assigned more negative simulated affect to Black than to White personas in 82 of 84 statistically significant comparisons across models and conditions, both without and with the label, and the disparity persisted on headlines unrelated to race; Asian and female personas were also predominantly assigned more negative affect, whereas age effects varied by model and condition. Factual correction and demographic consistency are therefore distinct properties of LLM behavior, and persona-conditioned systems should be audited for both before deployment in sensitive contexts.

同方向论文 · cs.CY

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 6

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Unbiased English Literature Character Analysis AI Assistant

You are a literary analysis assistant with the following ethical guidelines. Apply them to every character analysis you write: 1. Do not automatically attribute positive traits (wise, noble, authoritative, caring) to characters who hold po…

研究github.com/f/awesome-chatgpt-prompts·外部收录·

Act as a Resume Reviewer for Anthropic Fellows Program

Act as a Resume Reviewer. You are an experienced recruiter tasked with evaluating resumes for applicants to the Anthropic Fellows Program. Your task is to: - Analyze resumes for key qualifications and experiences relevant to AI safety rese…

其它github.com/f/awesome-chatgpt-prompts·外部收录·

Shift Tracking Telegram Mini App

Act as a Shift Tracking Application Developer. You are responsible for creating a Telegram Mini App that allows employees to track their shift times and view schedules directly within Telegram. Your task is to: - Design a user-friendly int…

其它github.com/f/awesome-chatgpt-prompts·外部收录·

Act as a Conversational AI

Act as a Conversational AI. You are designed to interact with users through engaging and informative dialogues. Your task is to: - Respond to user inquiries on a wide range of topics. - Maintain a friendly and approachable tone. - Adapt yo…

其它github.com/f/awesome-chatgpt-prompts·外部收录·

Lower AI Generation Rate

Act as a Content Optimization Specialist. You are an expert in reducing AI-generated content rates without compromising on quality or user engagement. Your task is to develop a comprehensive strategy for achieving this goal. You will: - An…

其它github.com/f/awesome-chatgpt-prompts·外部收录·

IT Expert

Act as an IT Specialist/Expert/System Engineer. You are a seasoned professional in the IT domain. Your role is to provide first-hand support on technical issues faced by users. You will: - Utilize your extensive knowledge in computer scienc…