跳到正文
返回论文列表
cs.CY提交于 已译

AI 能进行访谈吗?比较 AI 主导与人类主导的聊天访谈

Can AI interview? Comparing AI-led to Human-led Chat Interviews

Semra Guven · Tobias G{\aa}rdhus · Andreas Bjerre-Nielsen · Anna Rogers · Hjalmar Bang Carlsen

中文摘要

大语言模型聊天机器人被提议作为 AI 访谈者,以大规模收集定性访谈数据,弥合社会科学中调查广度与定性访谈深度之间的长期鸿沟。本研究首次直接实证比较了 AI 主导与人类主导访谈的数据质量。在随机实验(N = 41)中,大学生通过同步文本聊天接受训练有素的非专家访谈者或本地托管 AI 系统的访谈;评估维度包括暴露度、具体性和相关性。两种条件下访谈中位时长相似,但 AI 访谈者每次访谈提问数量多于一倍以上,并诱发受访者产生约 65% 更多的文本。人类访谈者的单题回答更长,但多重检验校正后不显著;仅 AI 条件参与者跳过问题。两种条件下回答几乎完全切题;具体性无显著差异,但设计无法排除最多四分之一的差异。结果基于小型本地托管开源权重模型(7B 参数),解决了数据安全、GDPR 合规及科学可重复性担忧。发现支持 AI 访谈用于大样本定性数据收集的可行性。

关键要点

  1. 01首次直接实证比较 AI 主导与人类主导定性访谈的数据质量,填补社会科学研究方法空白。
  2. 02随机实验显示 AI 访谈者提问数量多于一倍,诱发受访者文本量增加约 65%,但单题回答长度差异不显著。
  3. 03使用本地托管的 7B 参数开源权重模型,有效解决数据安全、GDPR 合规及科学可重复性顾虑。
  4. 04AI 访谈在暴露度、具体性和相关性上表现良好,支持其用于大规模定性数据收集的可行性。

解读

尚无解读。

原始英文摘要

arXiv:2610.23149v1 Announce Type: cross Abstract: Large language model chatbots have been proposed as AI-interviewers for collecting qualitative interview data at scale, potentially bridging social science's longstanding divide between the breadth of surveys and the depth of qualitative interviews. This paper provides the first direct empirical comparison of data quality in AI-led and human-led interviews. In a randomized experiment (N = 41), university students were interviewed via synchronous text chat by either trained non-expert interviewers or a locally hosted AI system; we evaluate exposure, specificity, and relevance. Median interview duration was similar across conditions, but AI-interviewers asked more than twice as many questions per interview and elicited roughly 65 percent more respondent text per interview. Per-question responses were longer with human interviewers, though not after multiple-testing correction; only AI-condition participants skipped questions. Responses were almost uniformly on-topic in both conditions; for specificity we detect no difference, but the design cannot exclude one of up to three quarters of a point. These results were obtained with a small, locally hosted open-weight model (7B parameters), which addresses concerns about data security, GDPR compliance, and scientific reproducibility. Our findings support the viability of AI-interviewing for large-N qualitative data collection.

同方向论文 · cs.CY

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 1

研究github.com/f/awesome-chatgpt-prompts·外部收录·

1Sentence Deck: pitch deck thesis interview

You are running the 1Sentence Deck method from 1sentencedeck.com. Follow it exactly. Interview me using the method’s own questions, one at a time. Wait for my answer before the next question. Never invent numbers or facts for me. The questi…