Background: Artificial intelligence (AI) can be a tool in the diagnosis and acquisition of knowledge, particularly in dentistry, sparking debates on its application in clinical decision-making.
Objective: This study aims to evaluate the accuracy, completeness, and reliability of the responses generated by Chatbot Generative Pre-Trained Transformer (ChatGPT) 3.5 in dentistry using expert-formulated questions.
Materials And Methods: Experts were invited to create three questions, answers, and respective references according to specialized fields of activity. The Likert scale was used to evaluate agreement levels between experts and ChatGPT responses. Statistical analysis compared descriptive and binary question groups in terms of accuracy and completeness. Questions with low accuracy underwent re-evaluation, and subsequent responses were compared for improvement. The Wilcoxon test was utilized (α = 0.05).
Results: Ten experts across six dental specialties generated 30 binary and descriptive dental questions and references. The accuracy score had a median of 5.50 and a mean of 4.17. For completeness, the median was 2.00 and the mean was 2.07. No difference was observed between descriptive and binary responses for accuracy and completeness. However, re-evaluated responses showed a significant improvement with a significant difference in accuracy (median 5.50 vs. 6.00; mean 4.17 vs. 4.80; p=0.042) and completeness (median 2.0 vs. 2.0; mean 2.07 vs. 2.30; p=0.011). References were more incorrect than correct, with no differences between descriptive and binary questions.
Conclusions: ChatGPT initially demonstrated good accuracy and completeness, which was further improved with machine learning (ML) over time. However, some inaccurate answers and references persisted. Human critical discernment continues to be essential to facing complex clinical cases and advancing theoretical knowledge and evidence-based practice.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11352766 | PMC |
| http://dx.doi.org/10.7759/cureus.65658 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Prospective validation study of a combined urine and plasma test for predicting high-grade prostate cancer in biopsy naïve men.
Scand J Urol
January 2025
Department of Urology, Odense University Hospital, Odense, Denmark; Academy of Geriatric Cancer Research (AgeCare), Odense University Hospital, Odense, Denmark; Department of Clinical Research, University of Southern Denmark, Odense, Denmark.
Objective: Early and accurate diagnosis of prostate cancer (PC) is crucial for effective treatment. Diagnosing clinically insignificant cancers can lead to overdiagnosis and overtreatment, highlighting the importance of accurately selecting patients for further evaluation based on improved risk prediction tools. Novel biomarkers offer promise for enhancing this diagnostic process.
View Article and Find Full Text PDFQuantitative evaluation of GPT-4's performance on US and Chinese osteoarthritis treatment guideline interpretation and orthopaedic case consultation.
BMJ Open
December 2024
Jinzhou Medical University, Jinzhou, Liaoning, China
Objectives: To evaluate GPT-4's performance in interpreting osteoarthritis (OA) treatment guidelines from the USA and China, and to assess its ability to diagnose and manage orthopaedic cases.
Setting: The study was conducted using publicly available OA treatment guidelines and simulated orthopaedic case scenarios.
Participants: No human participants were involved.
INSIGHT: A Tool for Fit-for-Purpose Evaluation and Quality Assessment of Standardized Observational Data Sources for Real World Evidence on Medicine and Vaccine Safety.
Pharmacoepidemiol Drug Saf
January 2025
Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands.
Purpose: To describe the development of INSIGHT, a real-world data quality tool to assess completeness, consistency, and fitness-for-purpose of observational health data sources.
Methods: We designed a three-level pipeline with data quality assessments (DQAs) to be performed in ConcePTION Common Data Model (CDM) instances. The pipeline has been coded using R.
Intriguing tumor, synovial sarcoma: hard to diagnose, harder to treat.
Orthop Traumatol Surg Res
January 2025
Ankara University Medical Faculty, İbni Sina Hospital, Department of Orthopedics and Traumatology, Talatpasa Boulevard no:82, 06630 Ankara, Turkey.
Background: Synovial sarcoma (SS) is classified as an aggressive high-grade soft tissue sarcoma that predominantly affects the extremities. Despite its prevalence in the extremities (up to 80%), diagnostic and treatment challenges persist. This study aims to address these challenges by providing a comprehensive analysis of SS in extremities, focusing on diagnostic accuracy and treatment outcomes.
View Article and Find Full Text PDFComparing analog and 3D measurements of vertical dimension in edentulous subjects.
J Dent
January 2025
Clinic of General-, Special Care- and Geriatric Dentistry, Center for Dental Medicine, University of Zurich, Zurich, Switzerland; School of Dentistry, Federal University of Goiàs, Goiania, Brazil; Department of Reconstructive Dentistry, Division of Gerodontology, School of Dental Medicine, University of Bern, Bern, Switzerland.
Objective: This study aimed to explore the feasibility and reliability of measuring the vertical dimension of occlusion/rest (OVD/RVD) on 3D facial scans of edentulous patients.
Methods: Nineteen edentulous participants rehabilitated with complete removable dental prostheses (CDs) participated in this study. Analog measurements (control) were obtained directly on the face for each participant with the jaws positioned at the rest position (without CDs, RVD) and at central occlusion (OVD), between the facial landmarks: Glabella (G) and Soft Pogonion (SP), Pronasale (PN) and SP, and Subnasale (SN) and SP.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!