Communications of the ACM
The Rise of Artificial Intelligence: ChatGPT's Stunning Results on the U.S. Medical Licensing Exam
ChatGPT demonstrated its ability to perform at or around the passing threshold of 60% on the U.S. Medical Licensing Exam.
Credit: SciTechDaily
OpenAI's ChatGPT can score at or around the approximately 60 percent passing threshold for the United States Medical Licensing Exam (USMLE), with responses that make coherent, internal sense and contain frequent insights. This is according to a study by Tiffany Kung, Victor Tseng, and colleagues at AnsibleHealth, which was published on February 9, 2023, in the open-access journal PLOS Digital Health.
ChatGPT is a new artificial intelligence (AI) system, known as a large language model (LLM), designed to generate human-like writing by predicting upcoming word sequences. Unlike most chatbots, ChatGPT cannot search the internet. Instead, it generates text using word relationships predicted by its internal processes.
Kung and colleagues tested ChatGPT's performance on the USMLE, a highly standardized and regulated series of three exams (Steps 1, 2CK, and 3) required for medical licensure in the United States. Taken by medical students and physicians-in-training, the USMLE assesses knowledge spanning most medical disciplines, ranging from biochemistry, to diagnostic reasoning, to bioethics.
From PLOS
View Full Article
No entries found