Purpose: Access to high-quality and comprehensible patient information is crucial. However, information provided by increasingly prevalent Artificial Intelligence tools has not been thoroughly investigated. This study assesses the quality and readability of information from ChatGPT regarding three index ENT operations: tonsillectomy, adenoidectomy, and grommets.
Methods: We asked ChatGPT standard and simplified questions. Readability was calculated using Flesch-Kincaid Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI) and Simple Measure of Gobbledygook (SMOG) scores. We assessed quality using the DISCERN instrument and compared these with ENT UK patient leaflets.
Results: ChatGPT readability was poor, with mean FRES of 38.9 and 55.1 pre- and post-simplification, respectively. Simplified information from ChatGPT was 43.6% more readable (FRES) but scored 11.6% lower for quality. ENT UK patient information readability and quality was consistently higher.
Conclusions: ChatGPT can simplify information at the expense of quality, resulting in shorter answers with important omissions. Limitations in knowledge and insight curb its reliability for healthcare information. Patients should use reputable sources from professional organisations alongside clear communication with their clinicians for well-informed consent and making decisions.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1007/s00405-024-08598-w | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Content Validity of the Friedreich Ataxia Rating Scale in Patients with Spinocerebellar Ataxia.
Neurol Ther
January 2025
Biohaven Pharmaceuticals, Inc., 215 Church Street, New Haven, CT, 06510, USA.
Introduction: The Friedreich Ataxia Rating Scale-Activities of Daily Living (FARS-ADL) is a validated and highly utilized measure for evaluating patients with Friedreich Ataxia. While construct validity of FARS-ADL has been shown for spinocerebellar ataxia (SCA), content validity has not been established.
Methods: Individuals with SCA1 or SCA3 (n = 7) and healthcare professionals (HCPs) with SCA expertise (n = 8) participated in qualitative interviews evaluating the relevance, clarity, and clinical meaningfulness of FARS-ADL for assessment of individuals with SCA.
Comparative Performance of the Leading Large Language Models in Answering Complex Rhinoplasty Consultation Questions.
Facial Plast Surg Aesthet Med
January 2025
Department of Otolaryngology-Head and Neck Surgery, University of California, Irvine, California, USA.
Various large language models (LLMs) can provide human-level medical discussions, but they have not been compared regarding rhinoplasty knowledge. To compare the leading LLMs in answering complex rhinoplasty consultation questions as evaluated by plastic surgeons. Ten open-ended rhinoplasty consultation questions were presented to ChatGPT-4o, Google Gemini, Claude, and Meta-AI LLMs.
View Article and Find Full Text PDFDirect-to-consumer semen analysis products: Content, accountability, and adherence to clinical guidelines.
Andrology
January 2025
Department of Urology, Brigham and Women's Hospital, Boston, Massachusetts, USA.
Background: Direct-to-consumer (DTC) semen analysis (SA) products obviate barriers that deter men from clinic testing and have made strides in providing higher quality data. However, it is unclear how well these products adhere to the 2021 WHO guidelines on examination and processing of human spermatozoa as they pertain to the evaluation of male fertility.
Objective: We investigate the content and adherence to clinical guidelines associated with consumer-facing information on DTC analysis products.
Development and validation of a pragmatic measure of cocreation in research engagement: a study protocol.
BMJ Open
December 2024
Department of Global Health, University of Washington, Seattle, Washington, USA.
Introduction: Cocreation, a collaborative process of key interested partners working alongside researchers, is fundamental to community-engaged research. However, the field of community-engaged research is currently grappling with a significant gap: the lack of a pragmatic and validated measure to assess the quality of this process. This protocol addresses this significant gap by developing and testing a pragmatic cocreation measure with diverse community and research partners involved in participatory health-related research.
View Article and Find Full Text PDFThe Role of Neuropsychology in the Management of Spinal Cord Injury: A Comprehensive Literature Review.
World Neurosurg
January 2025
Department of Neurosurgery, Hurley Medical Center, MI, USA.
Spinal cord injury (SCI) poses a complex set of physiological, psychological, and cognitive challenges that significantly affect an individual's quality of life. Analysis of longitudinal studies reveals that cognitive changes following SCI are often underestimated yet significantly impact patient's ability to adapt to their new circumstances. However, the role of neuropsychology in SCI management and rehabilitation is yet to be elucidated.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!