A PHP Error was encountered

Severity: Warning

Message: file_get_contents(https://...@pubfacts.com&api_key=b8daa3ad693db53b1410957c26c9a51b4908&a=1): Failed to open stream: HTTP request failed! HTTP/1.1 429 Too Many Requests

Filename: helpers/my_audit_helper.php

Line Number: 176

Backtrace:

File: /var/www/html/application/helpers/my_audit_helper.php
Line: 176
Function: file_get_contents

File: /var/www/html/application/helpers/my_audit_helper.php
Line: 250
Function: simplexml_load_file_from_url

File: /var/www/html/application/helpers/my_audit_helper.php
Line: 3122
Function: getPubMedXML

File: /var/www/html/application/controllers/Detail.php
Line: 575
Function: pubMedSearch_Global

File: /var/www/html/application/controllers/Detail.php
Line: 489
Function: pubMedGetRelatedKeyword

File: /var/www/html/index.php
Line: 316
Function: require_once

Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5. | LitMetric

Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5.

J Acad Ophthalmol (2017)

Department of Ophthalmology and Visual Sciences, UMass Chan Medical School, Worcester, Massachusetts.

Published: July 2023

AI Article Synopsis

  • This study evaluates the performance of ChatGPT-4 in the Ophthalmology Knowledge Assessment Program (OKAP) exam compared to ChatGPT-3.5.
  • Both models answered 180 practice questions, with ChatGPT-4 scoring significantly better (81% vs. 57%).
  • The results indicate that ChatGPT-4 has potential for use in ophthalmology education and clinical support, prompting further research on AI integration in medical training.

Article Abstract

 This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5.  Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories.  ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; <0.001), indicating improvements in medical knowledge assessment.  The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10495224PMC
http://dx.doi.org/10.1055/s-0043-1774399DOI Listing

Publication Analysis

Top Keywords

performance chatgpt-4
8
okap examination
8
improved performance
4
chatgpt-4 okap
4
examination comparative
4
comparative study
4
study chatgpt-35
4
chatgpt-35  this
4
 this study
4
study aims
4

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!