Reddit · r/artificial· /u/radeon2000·· 2 小时前AI 评分67
Crook Bench 用5个病例评测13个 AI 模型的门诊问诊能力
We put 13 AI models in the GP's chair for the five free cases. Results, every transcript, and how they did on the penicillin allergy: discussion's over in r/artificial. Play the same cases: doctorfoo.ai
AI 导读
Crook Bench 将13个 AI 模型置于全科医生角色，通过工具调用完成问诊、检查、开药、转诊和诊断，并在5个病例上进行195次问诊评测。模型在191次问诊中给出正确答案，但总分仍为27%至85%；GPT-6.1 Sol 与 GPT-6 Astra 以85%并列最高，部分模型还存在未询问青霉素过敏史仍开药的问题。
来源：Reddit · r/artificial · reddit.com