跳到正文
返回论文列表
cs.CV提交于 已译

耦合还是独立?智能体医疗视觉系统中的故障耦合

Coupled or Independent? Fault Coupling in Agentic Medical Vision Systems

Nishi Kanta Paul · Md Shihabul Islam Shovo · Md Mostafijur Rahman · Jamil Fayyad

中文摘要

配备工具的视觉语言智能体可暴露中间输出,供检查并与模型推理比较,这可能比单次模型更具安全性。本文测试当传感器读数本身不可信、工具与推理通道共享同一视觉故障时,这种潜在收益是否成立。研究基于分割、对比检索和迭代视觉语言推理器的皮肤科智能体,定义耦合分类法,区分单通道错误与一致或不一致的联合错误。在 PAD-UFES-20 上,排版注入产生可检测的方向性检索捕获,而物理损坏则不能。裁剪优先检索以可读尺度保留载荷,在所有案例中产生 55% 的联合错误一致(故障案例中 71%);全图检索为 35%(43%)。在二值决策下,若两通道均错误,其预测必然一致,因此硬标签通道比较无法检测联合故障,使不一致召回率限于 0.29(裁剪优先)对 0.57(全图)。顺序效应的方向在独立 HIBA 测试集上得到复现。

关键要点

  1. 01测试工具与推理通道共享视觉故障时,中间输出可检查性是否仍带来安全收益
  2. 02提出耦合分类法,区分单通道错误与一致/不一致的联合错误
  3. 03排版注入产生可检测的方向性检索捕获,物理损坏则不能
  4. 04裁剪优先检索联合错误一致率 55%(故障案例 71%),全图检索 35%(43%)
  5. 05二值决策下硬标签比较无法检测联合故障,不一致召回率 0.29 对 0.57

解读

尚无解读。

原始英文摘要

arXiv:2610.40913v1 Announce Type: new Abstract: Vision-language agents equipped with tools expose intermediate outputs for inspection and comparison with the model's reasoning, which may offer safety benefits over single-shot models. This paper tests that potential benefit when the sensor reading itself is untrusted, so that the tool and reasoning channels share a common visual fault. We consider a dermatology agent based on segmentation, contrastive retrieval, and an iterative vision-language reasoner and define a coupling taxonomy that distinguishes single-channel errors from joint errors that agree or disagree. On PAD-UFES-20, we show that typographic injection produces detectable directional retrieval capture, whereas physical corruption does not. Crop-first retrieval preserves the payload at a readable scale and produces 55% joint wrong agreement across all cases (71% of faulty cases); full-image retrieval produces 35% (43%). Under a binary decision, if both channels are wrong, their predictions must agree, so hard-label channel comparison cannot detect joint failures, limiting disagreement recall to 0.29 (crop-first) versus 0.57 (full-image). The direction of the order effect is reproduced on the independent HIBA test set.

同方向论文 · cs.CV

查看全部 →

反向发现 · 这篇论文相关的工具与提示词

去交叉发现 →

关联提示词 · 1

视频github.com/f/awesome-chatgpt-prompts·外部收录·

YouTube Video Downloader Skill

--- name: youtube-video-downloader-skill description: Helps download YouTube videos. Asks for the video URL and preferred quality, then outlines the steps and tools to fetch the video safely. --- # YouTube Video Downloader Skill Download …