ChatGPT, a language model developed by OpenAI, has been tested in several medical board examinations. This study aims to evaluate the performance of ChatGPT on the Portuguese National Residency Access Examination, a mandatory test for medical residency in Portugal. The study specifically compares the capabilities of ChatGPT versions 3.5 and 4o across five examination editions from 2019 to 2023. A total of 750 multiple-choice questions were submitted to both versions, and their answers were evaluated against the official responses. The findings revealed that ChatGPT 4o significantly outperformed ChatGPT 3.5, with a median examination score of 127 compared to 106 (p = 0.048). Notably, ChatGPT 4o achieved scores within the top 1% in two examination editions and exceeded the median performance of human candidates in all editions. Additionally, ChatGPT 4o's scores were high enough to qualify for any specialty. In conclusion, ChatGPT 4o can be a valuable tool for medical education and decision-making, but human oversight remains essential to ensure safe and accurate clinical practice.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.20344/amp.22506 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Combined exercise-induced modulation of Notch pathway and muscle quality in senescence-accelerated mice.
Pflugers Arch
January 2025
School of Physical Education and Sport of Ribeirão Preto, University of São Paulo (USP), Avenida Bandeirantes, 3900, Monte Alegre, Ribeirão Preto, São Paulo, 14040-907, Brazil.
The Notch signaling pathway is crucial for skeletal muscle development, regeneration, inflammation, and aging. This study investigated the association between interleukin-10 (IL-10) and the Notch pathway in C2C12 cells, as well as explored the effects of combined endurance and resistance exercise on the Notch and autophagy pathways in the skeletal muscle of senescence-accelerated mouse-resistant 1 Sedentary (SAMR1 CT), SAMR1 exercised (SAMR1 EX), senescence-accelerated prone mouse 8 Sedentary (SAMP8 CT), and SAMP8 exercised (SAMP8 EX). C2C12 myoblasts were transfected with siIL-10.
View Article and Find Full Text PDFRespiratory diseases pose a significant global health burden, with challenges in early and accurate diagnosis due to overlapping clinical symptoms, which often leads to misdiagnosis or delayed treatment. To address this issue, we developed , an artificial intelligence (AI)-based diagnostic system that utilizes natural language processing (NLP) to extract key clinical features from electronic health records (EHRs) for the accurate classification of respiratory diseases. This study employed a large cohort of 31,267 EHRs from multiple centers for model training and internal testing.
View Article and Find Full Text PDFEvaluating ChatGPT and Google Gemini Performance and Implications in Turkish Dental Education.
Cureus
January 2025
Pedodontics, Istanbul Turkuaz Dental Clinic, Istanbul, TUR.
Artificial intelligence (AI) has emerged as a transformative tool in education, particularly in specialized fields such as dentistry. This study evaluated the performance of four advanced AI models - ChatGPT-4o (San Francisco, CA: OpenAI), ChatGPT-o1, Gemini 1.5 Pro (Mountain View, CA: Google LLC), and Gemini 2.
View Article and Find Full Text PDFThe use of a ChatGPT-4-based chatbot in teledermatology: A retrospective exploratory study.
J Dtsch Dermatol Ges
January 2025
Sheba Medical Center, Tel Hashomer, Sackler School of Medicine, Faculty of Medical and Health Sciences, Tel Aviv University, Israel.
Background And Objectives: Integration of artificial intelligence in healthcare, particularly ChatGPT, is transforming medical diagnostics and may benefit teledermatology. This exploratory study compared image description and differential diagnosis generation by a ChatGPT-4 based chatbot with human teledermatologists.
Patients And Methods: This retrospective study compared 154 teledermatology consultations (December 2023-February 2024) with ChatGPT-4's performance in image descriptions and diagnoses.
The role of artificial intelligence in gynecologic and obstetric emergencies.
Eur J Obstet Gynecol Reprod Biol
January 2025
Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany. Electronic address:
Objective: To investigate the potential of artificial intelligence (AI) in emergency medicine, focusing on its utility in triaging and managing acute gynecologic and obstetric emergencies.
Methods And Materials: This feasibility study assessed Chat-GPT's performance in triaging and recommending management interventions for gynecologic and obstetric emergencies, using ten fictive cases. Five common conditions were modeled for each specialty.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!