Systematic review of ChatGPT accuracy and performance in Iran's medical licensing exams: A brief report.

J Educ Health Promot

Department of Medicine, Clinical Education Research Center, Shiraz University of Medical Sciences, Shiraz, Iran.

Published: November 2024

ChatGPT has demonstrated significant potential in various aspects of medicine, including its performance on licensing examinations. In this study, we systematically investigated ChatGPT's performance in Iranian medical exams and assessed the quality of the included studies using a previously published assessment checklist. The study found that ChatGPT achieved an accuracy range of 32-72% on basic science exams, 34-68.5% on pre-internship exams, and 32-84% on residency exams. Notably, its performance was generally higher when the input was provided in English compared to Persian. One study reported a 40% accuracy rate on an endodontic board exam. To establish ChatGPT as a supplementary tool in medical education and clinical practice, we suggest that dedicated guidelines and checklists are needed to ensure high-quality and consistent research in this emerging field.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11731324PMC
http://dx.doi.org/10.4103/jehp.jehp_1210_24DOI Listing

Publication Analysis

Top Keywords

exams
5
systematic review
4
chatgpt
4
review chatgpt
4
chatgpt accuracy
4
performance
4
accuracy performance
4
performance iran's
4
iran's medical
4
medical licensing
4

Similar Publications

Background/purpose: Dentists often focus on masticatory performance (MP) rather than masticatory ability (MA) and treatment expectations when evaluating older adults. This study aimed to determine if MA aligns with MP and to explore influencing factors.

Materials And Methods: This cross-sectional study utilized a multi-stage stratified cluster sampling, including one thousand community-dwelling adults aged 60 and older.

View Article and Find Full Text PDF

Background: Measuring brain volume changes over time is an objective and dependable surrogate marker for the pathological processes that damage the brain in relapsing-remitting multiple sclerosis (RRMS). These measures are particularly valuable for monitoring the long-term impact of immunomodulatory treatments such as cladribine.

Objectives: To evaluate the long-term impact of oral cladribine treatment on brain volume loss in patients with RRMS.

View Article and Find Full Text PDF

Purpose: The purpose of this study was to determine the sensitivity and specificity of the Yale Swallow Protocol (YSP) in detecting aspiration in recently extubated patients.

Method: One hundred fifty-four participants referred for swallowing evaluation underwent the YSP and fiberoptic endoscopic evaluation of swallowing (FEES) in random order within 48 hr of extubation. The YSP included orientation questions, an oral motor exam, and a 3-oz water swallow test.

View Article and Find Full Text PDF

Search for Healthcare and Breast/Gynecological Cancer Prevention Among Brazilian Lesbian Cisgender Women.

Cancer Invest

January 2025

Psychology Department, Faculty of Philosophy, Sciences and Letters at Ribeirão Preto, University of São Paulo, Ribeirão Preto-SP, Brazil.

Although breast, cervical, endometrial, and ovarian cancers account for more than 43% of new cases in 2023 in Brazilian women, no national studies were found on the incidence, risk factors, and prevention of breast and gynecological neoplasms in lesbian women, causing the health needs of non-heterosexual women to go unnoticed by professionals. This study aims to identify and analyze the search for healthcare related to the prevention of breast/gynecological cancer among Brazilian lesbian cisgender women who have not had the disease. Seven lesbian women participated in this qualitative study.

View Article and Find Full Text PDF

Background: The aging population is increasingly affected by periodontal disease, a condition often overlooked due to its asymptomatic nature. Despite its silent onset, periodontitis is linked to various systemic conditions, contributing to severe complications and a reduced quality of life. With over a billion people globally affected, periodontal diseases present a significant public health challenge.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!