Background: The rapid development of artificial intelligence (AI) technologies like OpenAI's Generative Pretrained Transformer (GPT), particularly ChatGPT, has shown promising applications in various fields, including medicine. This study evaluates ChatGPT's performance on the Polish Final Medical Examination (LEK), comparing its efficacy to that of human test-takers.
Methods: The study analyzed ChatGPT's ability to answer 196 multiple-choice questions from the spring 2021 LEK. Questions were categorized into "clinical cases" and "other" general medical knowledge, and then divided according to medical fields. Two versions of ChatGPT (3.5 and 4.0) were tested. Statistical analyses, including Pearson's χ test, and Mann-Whitney U test, were conducted to compare the AI's performance and confidence levels.
Results: ChatGPT 3.5 correctly answered 50.51% of the questions, while ChatGPT 4.0 answered 77.55% correctly, surpassing the 56% passing threshold. Version 3.5 showed significantly higher confidence in correct answers, whereas version 4.0 maintained consistent confidence regardless of answer accuracy. No significant differences in performance were observed across different medical fields.
Conclusions: ChatGPT 4.0 demonstrated the ability to pass the LEK, indicating substantial potential for AI in medical education and assessment. Future improvements in AI models, such as the anticipated ChatGPT 5.0, may enhance further performance, potentially equaling or surpassing human test-takers.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11366403 | PMC |
| http://dx.doi.org/10.7759/cureus.66011 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Estimation of Central Aortic Pressure Waveforms by Combination of a Meta-Learning Neural Network and a Physics-Driven Method.
Int J Numer Method Biomed Eng
January 2025
College of Chemistry and Life Science, Beijing University of Technology, Beijing, China.
The accurate non-invasive detection and estimation of central aortic pressure waveforms (CAPW) are crucial for reliable treatments of cardiovascular system diseases. But the accuracy and practicality of current estimation methods need to be improved. Our study combines a meta-learning neural network and a physics-driven method to accurately estimate CAPW based on personalized physiological indicators.
View Article and Find Full Text PDFFully 3D-Printed Soft Capacitive Sensor of High Toughness and Large Measurement Range.
Adv Sci (Weinh)
January 2025
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, 518172, P. R. China.
Soft capacitive sensors are widely utilized in wearable devices, flexible electronics, and soft robotics due to their high sensitivity. However, they may suffer delamination and/or debonding due to their low interfacial toughness. In addition, they usually exhibit a small measurement range resulting from their limited stiffness variation range.
View Article and Find Full Text PDFIncidence of fall-from-height injuries and predictive factors for severity.
J Osteopath Med
January 2025
McAllen Department of Trauma, South Texas Health System, McAllen, TX, USA.
Context: The injuries caused by falls-from-height (FFH) are a significant public health concern. FFH is one of the most common causes of polytrauma. The injuries persist to be significant adverse events and a challenge regarding injury severity assessment to identify patients at high risk upon admission.
View Article and Find Full Text PDFA Soft Robotic Sleeve for Physiotherapy: Improving Elbow Rehabilitation in Baseball Pitchers.
Physiother Res Int
January 2025
Department of Biomedical Engineering, University of Engineering and Technology (UET) Lahore, Narowal Campus, Narowal, Pakistan.
Background And Purpose: Throwing a baseball involves intense exposure of the arm to high speeds and powerful forces, which contributes to an increasing prevalence of arm injuries among athletes. Traditional rigid exoskeletons and rehabilitation equipment frequently lack portability, safety, ergonomic design, and affordability. Traditional rehabilitation approaches frequently require therapist monitoring, resulting in therapy delays.
View Article and Find Full Text PDFSTMGraph: spatial-context-aware of transcriptomes via a dual-remasked dynamic graph attention model.
Brief Bioinform
November 2024
Center for Genomics and Biotechnology, Fujian Provincial Key Laboratory of Haixia Applied Plant Systems Biology, Haixia Institute of Science and Technology, Fujian Agriculture and Forestry University, No. 15 Shangxiadian Road, Cangshan District, Fuzhou 350002, China.
Spatial transcriptomics (ST) technologies enable dissecting the tissue architecture in spatial context. To perceive the global contextual information of gene expression patterns in tissue, the spatial dependence of cells must be fully considered by integrating both local and non-local features by means of spatial-context-aware. However, the current ST integration algorithm ignores for ST dropouts, which impedes the spatial-aware of ST features, resulting in challenges in the accuracy and robustness of microenvironmental heterogeneity detecting, spatial domain clustering, and batch-effects correction.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!