The authors adapted 1,391 clinical cases from the MedQA and DiagnosisArena datasets.
AI models adopt patients' false diagnoses 23% of the time in medical tasks
Varying how incorrect the patient's belief is, researchers show models change diagnosis even for made-up conditions.
Top University
Viswonathan Manoranjan · Andrea Mock · Myra Cheng · Lujain Ibrahim · Andrew Coyne · Junyi Jessy Li · +1 more
University of North Carolina at Chapel Hill · Vals AI · Stanford University · University of Oxford · The University of Texas at Austin
Research Digest··3 min read
Manoranjan et al. evaluated nine AI models on 1,391 medical cases, holding clinical evidence constant while varying the patient's belief from a close distractor to a made-up disease.
The Daily Edition
The front page in your inbox each weekday morning: the lead, the picks, and why each one earned its place.