AMIE Video Matches Primary Care Doctors in 300 Simulated Consultations
Updated
Updated · Google Research · Aug 11
AMIE Video Matches Primary Care Doctors in 300 Simulated Consultations
2 articles · Updated · Google Research · Aug 11
Summary
Google said AMIE (Video) reached expert-level performance in a randomized study of 300 live video consultations across 100 clinical scenarios, with evaluators rating it on par with board-certified primary care physicians.
Three parallel agents let the system keep natural response speed while simultaneously processing audio-visual cues, guiding virtual physical exams and performing diagnostic reasoning in real time.
Clinical evaluators rated AMIE (Video) significantly higher than both physicians and text-only AMIE at eliciting physical signs and directing examination maneuvers, while patient actors preferred the video format for ease, empathy and communication.
The study used 15 trained patient actors, 30 primary care physicians and an independent panel of 20 physician evaluators, making it a simulated OSCE rather than a real-patient trial.
Google said occasional perceptual, reasoning and technical errors remain, and that real-world validation is still needed despite ongoing studies with Beth Israel Deaconess Medical Center and Included Health.