跳到正文
返回论文列表
cs.MM提交于 已译

有害YouTube视频检测:在线伤害分类法与多模态大语言模型作为替代标注者

Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators

Claire Wonjeong Jo · Miki Weso{\l}owska · Magdalena Wojcieszak

中文摘要

视频平台因向用户暴露有害内容而受到批评,但在线伤害检测因定义不一致和人工标注局限性而极具挑战。该研究整合并扩展现有分类法及平台指南至多模态语境,构建了包含信息、仇恨与骚扰、成瘾性、标题党、性、身体伤害六大类的在线伤害分类体系。方法上,系统测试多模态大语言模型(MLLMs)作为有害视频的替代标注者。研究构建了包含19,422个潜在有害YouTube视频的基准数据集,并使用GPT-4-Turbo、未受训众包工人及受训标注者进行标注。结果表明,在二元和多标签分类任务中,MLLMs的表现与人工标注者相当,展示了其在平台内容审核及社会科学研究中的应用潜力。

关键要点

  1. 01针对在线伤害定义不一致及人工标注局限,构建涵盖六大类的多模态在线伤害分类法。
  2. 02提出并系统测试多模态大语言模型(MLLMs)作为有害视频检测的替代标注者。
  3. 03构建包含19,422个潜在有害YouTube视频的基准数据集,使用GPT-4-Turbo及人工进行标注。
  4. 04实验显示MLLMs在二元和多标签分类任务中表现与人工标注者相当,适用于内容审核。

解读

尚无解读。

原始英文摘要

arXiv:2411.05854v2 Announce Type: replace-cross Abstract: Video platforms, used by billions globally, are criticized for exposing users to harmful content. Yet, detecting online harm remains challenging due to inconsistent approaches to what constitutes harm and limitations of human annotation. We address both challenges. Theoretically, we integrate and expand existing taxonomies and platform guidelines to multimodal contexts and develop a comprehensive taxonomy for online harm. We categorize online harm on video platforms into six content-based categories: Information, Hate and harassment, Addictive, Clickbait, Sexual, and Physical harms. Methodologically, we propose and systematically test multimodal large language models (MLLMs) as alternative annotators of harmful videos. We curate a dataset of 19,422 potentially harmful YouTube videos and annotate them using GPT-4-Turbo, non-trained crowdworkers, and trained annotators. We discuss the potential applications of MLLMs in platform content moderation and social science research, particularly in contexts where they perform comparably to human annotators in binary and multi-label classification tasks.

同方向论文 · cs.MM

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 1

图像github.com/f/awesome-chatgpt-prompts·外部收录·

Photo Story Gallery

- For each photo the user sends, read EXIF date and place, ask for missing details, and draft a caption and short story in the user's voice and language. - Make a high-quality web version and thumbnail; never alter the original file. - Add …