AI Article Synopsis
- The study evaluated the accuracy and scope of medical information about total shoulder arthroplasty (TSA) provided by ChatGPT-4 compared to Google search results.
- Both platforms offered similar accuracy for FAQs requiring numerical answers, but ChatGPT-4 exclusively used academic sources while Google included various types of sources, such as medical practices and social media.
- The findings suggest that although both sources had comparable accuracy and clinical relevance, ChatGPT-4 mainly relied on trustworthy academic references, while Google’s information was more diverse and potentially less reliable.
Article Abstract
Purpose: To determine the scope and accuracy of medical information provided by ChatGPT-4 in response to clinical queries concerning total shoulder arthroplasty (TSA), and to compare these results to those of the Google search engine.
Methods: A patient-replicated query for 'total shoulder replacement' was performed using both Google Web Search (the most frequently used search engine worldwide) and ChatGPT-4. The top 10 frequently asked questions (FAQs), answers, and associated sources were extracted. This search was performed again independently to identify the top 10 FAQs necessitating numerical responses such that the concordance of answers could be compared between Google and ChatGPT-4. The clinical relevance and accuracy of the provided information were graded by two blinded orthopaedic shoulder surgeons.
Results: Concerning FAQs with numeric responses, 8 out of 10 (80%) had identical answers or substantial overlap between ChatGPT-4 and Google. Accuracy of information was not significantly different ( = 0.32). Google sources included 40% medical practices, 30% academic, 20% single-surgeon practice, and 10% social media, while ChatGPT-4 used 100% academic sources, representing a statistically significant difference ( = 0.001). Only 3 out of 10 (30%) FAQs with open-ended answers were identical between ChatGPT-4 and Google. The clinical relevance of FAQs was not significantly different ( = 0.18). Google sources for open-ended questions included academic (60%), social media (20%), medical practice (10%) and single-surgeon practice (10%), while 100% of sources for ChatGPT-4 were academic, representing a statistically significant difference ( = 0.0025).
Conclusion: ChatGPT-4 provided trustworthy academic sources for medical information retrieval concerning TSA, while sources used by Google were heterogeneous. Accuracy and clinical relevance of information were not significantly different between ChatGPT-4 and Google.
Level Of Evidence: Level IV cross-sectional.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11649951 | PMC |
| http://dx.doi.org/10.1002/jeo2.70114 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Considerations on the Clinical Relevance of Climatic Differences in Rates in Diabetic Foot Infection.
Open Forum Infect Dis
January 2025
Division of Infectious Disease Therapeutics, Department of Microbiology and Infectious Diseases, Kobe University Graduate School of Medicine, Kobe, Japan.
Vascularized tumor on a microfluidic chip to study mechanisms promoting tumor neovascularization and vascular targeted therapies.
Theranostics
January 2025
Molecular Pharmacology Program, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
The cascade of events leading to tumor formation includes induction of a tumor supporting neovasculature, as a primary hallmark of cancer. Developing vasculature is difficult to evaluate but can be captured using microfluidic chip technology and patient derived cells. Herein, we established an approach to investigate the mechanisms promoting tumor vascularization and vascular targeted therapies via co-culture of cancer spheroids and endothelial cells in a three dimensional environment.
View Article and Find Full Text PDFAn Adverse Outcome Pathway for food nanomaterial-induced intestinal barrier disruption.
Front Toxicol
December 2024
Institute of Experimental and Clinical Research, UCLouvain, Brussels, Belgium.
Introduction: The ingestion of nanomaterials (NMs) may impair the intestinal barrier, but the underlying mechanisms remain evasive, and evidence has not been systematically gathered or produced. A mechanistic-based approach would be instrumental in assessing whether relevant NMs disrupt the intestinal barrier, thereby supporting the NM risk assessment in the food sector.
Methods: In this study, we developed an adverse outcome pathway (AOP) based on biological plausibility and by leveraging information from an existing NM-relevant AOP that leads to hepatic outcomes.
Metastatic urothelial carcinoma in multiple appendicular muscles of a cat.
JFMS Open Rep
January 2025
Department of Anatomy, Comparative Pathology and Toxicology, University of Córdoba, Campus de Rabanales, Córdoba, Spain.
Case Summary: A 13-year-old male castrated domestic shorthair cat presented with a 2-month history of progressive lameness, poor appetite and constipation. Physical examination revealed palpable lesions in muscles of several extremities. Ultrasound examination confirmed the presence of round lesions with a hypo- or anechoic centre within the muscles.
View Article and Find Full Text PDFPredicting the risk of type 2 diabetes mellitus (T2DM) emergence in 5 years using mammography images: a comparison study between radiomics and deep learning algorithm.
J Med Imaging (Bellingham)
January 2025
The University of Tokyo Hospital, Department of Radiology, Tokyo, Japan.
Purpose: The prevalence of type 2 diabetes mellitus (T2DM) has been steadily increasing over the years. We aim to predict the occurrence of T2DM using mammography images within 5 years using two different methods and compare their performance.
Approach: We examined 312 samples, including 110 positive cases (developed T2DM after 5 years) and 202 negative cases (did not develop T2DM) using two different methods.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!