Purpose: In recent years artificial intelligence (AI), as a new segment of computer science, has also become increasingly more important in medicine. The aim of this project was to investigate whether the current version of ChatGPT (ChatGPT 4.0) is able to answer open questions that could be asked in the context of a German board examination in ophthalmology.
Methods: After excluding image-based questions, 10 questions from 15 different chapters/topics were selected from the textbook 1000 questions in ophthalmology (1000 Fragen Augenheilkunde 2nd edition, 2014). ChatGPT was instructed by means of a so-called prompt to assume the role of a board certified ophthalmologist and to concentrate on the essentials when answering. A human expert with considerable expertise in the respective topic, evaluated the answers regarding their correctness, relevance and internal coherence. Additionally, the overall performance was rated by school grades and assessed whether the answers would have been sufficient to pass the ophthalmology board examination.
Results: The ChatGPT would have passed the board examination in 12 out of 15 topics. The overall performance, however, was limited with only 53.3% completely correct answers. While the correctness of the results in the different topics was highly variable (uveitis and lens/cataract 100%; optics and refraction 20%), the answers always had a high thematic fit (70%) and internal coherence (71%).
Conclusion: The fact that ChatGPT 4.0 would have passed the specialist examination in 12 out of 15 topics is remarkable considering the fact that this AI was not specifically trained for medical questions; however, there is a considerable performance variability between the topics, with some serious shortcomings that currently rule out its safe use in clinical practice.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1007/s00347-024-02046-0 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Derivation and validation of a clinical predictive model for longer duration diarrhea among pediatric patients in Kenya using machine learning algorithms.
BMC Med Inform Decis Mak
January 2025
Kenya Medical Research Institute- Center for Global Health Research (KEMRI-CGHR), P.O Box 1578-40100, Kisumu, Kenya.
Background: Despite the adverse health outcomes associated with longer duration diarrhea (LDD), there are currently no clinical decision tools for timely identification and better management of children with increased risk. This study utilizes machine learning (ML) to derive and validate a predictive model for LDD among children presenting with diarrhea to health facilities.
Methods: LDD was defined as a diarrhea episode lasting ≥ 7 days.
Congenital muscular dystrophies and myopathies: the leading cause of genetic muscular disorders in eleven Chinese families.
BMC Musculoskelet Disord
January 2025
Medical Genetic Diagnosis and Therapy Center, Fujian Maternity and Child Health Hospital, College of Clinical Medicine for Obstetrics and Gynecology and Pediatrics, Fujian Medical University, 18 Daoshan Road, Fuzhou, 350001, China.
Background: Congenital muscular dystrophies (CMDs) and myopathies (CMYOs) are a clinically and genetically heterogeneous group of neuromuscular disorders that share common features, such as muscle weakness, hypotonia, characteristic changes on muscle biopsy and motor retardation. In this study, we recruited eleven families with early-onset neuromuscular disorders in China, aimed to clarify the underlying genetic etiology.
Methods: Essential clinical tests, such as biomedical examination, electromyography and muscle biopsy, were applied to evaluate patient phenotypes.
Association between domain-specific physical activity and triglyceride‑glucose (TyG) index among US adults: Evidence from NHANES 2007-2018.
BMC Public Health
January 2025
Department of Neurology, Jinshan Hospital, Fudan University, 1508 Longhang Road, Jinshan District, Shanghai, China, 201508.
Objectives: The triglyceride-glucose (TyG) index is not only a reliable marker for insulin resistance, but also has broad applications in assessing the risk of various diseases, including cardiovascular disease, stroke, depression, and Alzheimer's disease. The study aims to investigate the relationship between domain-specific moderate- or vigorous-intensity physical activity (MVPA) and TyG index among US adults.
Methods: The participants from the US National Health and Nutrition Examination Survey (NHANES) (2007-2018) were included.
Temporal changes of tibial eminence after bi-cruciate retaining total knee arthroplasty.
BMC Musculoskelet Disord
January 2025
Department of Orthopaedic Surgery, Faculty of Medicine, The University of Tokyo, Tokyo City, Japan.
Background: Bicruciate-retaining (BCR) prostheses have been introduced to recreate normal knee movements by preserving both the anterior and posterior cruciate ligaments. One of the surgical procedures essential to the success of BCR total knee arthroplasty (TKA) is preservation of the tibial eminence. However, in our clinical experience, we found that a well-preserved tibial eminence changed its shape chronologically after the operation.
View Article and Find Full Text PDFAssociation between combined healthy lifestyles and infertility: a cross-sectional study in US reproductive-aged women.
BMC Public Health
January 2025
Reproductive Medicine Centre, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People's Hospital, Shenzhen, 518035, China.
Background: Infertility is a widespread problem for couples worldwide, and lifestyle factors are the cornerstone of infertility prevention. This research seeks to explore the association between combined healthy lifestyles and infertility risk among women of reproductive age.
Methods: This study analyzed data from the National Health and Nutrition Examination Survey (NHANES, 2013-2018), concentrating on 2,154 women aged 18 to 44.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!