AI Article Synopsis

  • The study evaluates ChatGPT's performance in answering questions and solving clinical scenarios in interceptive orthodontics, involving 21 questions and 7 cases created by specialized orthodontists.
  • The results indicate that ChatGPT achieved a median accuracy score of 4.9/6 and a completeness score of 2.4/3 for open-ended questions, with 40.5% of answers deemed entirely accurate and 50.5% entirely complete.
  • While the AI demonstrated a high level of accuracy and completeness, it still falls short of 100%, emphasizing that it cannot fully replace human expertise in clinical decision-making.

Article Abstract

: this study aims to investigate the accuracy and completeness of ChatGPT in answering questions and solving clinical scenarios of interceptive orthodontics. : ten specialized orthodontists from ten Italian postgraduate orthodontics schools developed 21 clinical open-ended questions encompassing all of the subspecialities of interceptive orthodontics and 7 comprehensive clinical cases. Questions and scenarios were inputted into ChatGPT4, and the resulting answers were evaluated by the researchers using predefined accuracy (range 1-6) and completeness (range 1-3) Likert scales. : For the open-ended questions, the overall median score was 4.9/6 for the accuracy and 2.4/3 for completeness. In addition, the reviewers rated the accuracy of open-ended answers as entirely correct (score 6 on Likert scale) in 40.5% of cases and completeness as entirely correct (score 3 n Likert scale) in 50.5% of cases. As for the clinical cases, the overall median score was 4.9/6 for accuracy and 2.5/3 for completeness. Overall, the reviewers rated the accuracy of clinical case answers as entirely correct in 46% of cases and the completeness of clinical case answers as entirely correct in 54.3% of cases. : The results showed a high level of accuracy and completeness in AI responses and a great ability to solve difficult clinical cases, but the answers were not 100% accurate and complete. ChatGPT is not yet sophisticated enough to replace the intellectual work of human beings.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10856539PMC
http://dx.doi.org/10.3390/jcm13030735DOI Listing

Publication Analysis

Top Keywords

entirely correct
16
accuracy completeness
12
interceptive orthodontics
12
clinical cases
12
answers entirely
12
accuracy
8
open-ended questions
8
median score
8
score 49/6
8
49/6 accuracy
8

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!