Artificial intelligence insights into osteoporosis: assessing ChatGPT's information quality and readability.

Arch Osteoporos

Clinic of Physical Medicine and Rehabilitation, Başakşehir Çam and Sakura City Hospital, Olympic Boulevard Road, 34480, Istanbul, Turkey.

Published: March 2024

AI Article Synopsis

  • - The study evaluated the quality and readability of osteoporosis information provided by ChatGPT, finding that it was complex and required around 17 years of education to fully understand.
  • - Tools like EQIP and Flesch-Kincaid were used to assess responses, revealing serious quality issues and low readability scores, indicating that the information may not be easy for patients to comprehend.
  • - Despite ChatGPT being a readily available resource for health information, the findings suggest it does not meet the necessary healthcare standards for quality and accessibility.

Article Abstract

Unlabelled: Accessible, accurate information, and readability play crucial role in empowering individuals managing osteoporosis. This study showed that the responses generated by ChatGPT regarding osteoporosis had serious problems with quality and were at a level of complexity that that necessitates an educational background of approximately 17 years.

Purpose: The use of artificial intelligence (AI) applications as a source of information in the field of health is increasing. Readable and accurate information plays a critical role in empowering patients to make decisions about their disease. The aim was to examine the quality and readability of responses provided by ChatGPT, an AI chatbot, to commonly asked questions regarding osteoporosis, representing a major public health problem.

Methods: "Osteoporosis," "female osteoporosis," and "male osteoporosis" were identified by using Google trends for the 25 most frequently searched keywords on Google. A selected set of 38 keywords was sequentially inputted into the chat interface of the ChatGPT. The responses were evaluated with tools of the Ensuring Quality Information for Patients (EQIP), the Flesch-Kincaid Grade Level (FKGL), and the Flesch-Kincaid Reading Ease (FKRE).

Results: The EQIP score of the texts ranged from a minimum of 36.36 to a maximum of 61.76 with a mean value of 48.71 as having "serious problems with quality." The FKRE scores spanned from 13.71 to 56.06 with a mean value of 28.71 and the FKGL varied between 8.48 and 17.63, with a mean value of 13.25. There were no statistically significant correlations between the EQIP score and the FKGL or FKRE scores.

Conclusions: Although ChatGPT is easily accessible for patients to obtain information about osteoporosis, its current quality and readability fall short of meeting comprehensive healthcare standards.

Download full-text PDF

Source
http://dx.doi.org/10.1007/s11657-024-01376-5DOI Listing

Publication Analysis

Top Keywords

quality readability
12
role empowering
8
eqip score
8
osteoporosis
5
quality
5
artificial intelligence
4
intelligence insights
4
insights osteoporosis
4
osteoporosis assessing
4
assessing chatgpt's
4

Similar Publications

Introduction: Informed consent documents (ICDs) are integral to a research project and must provide all required information to the participant. We undertook a 6-year retrospective cross-sectional analysis of ICDs to assess the same.

Methods: We accessed 300 ICDs from studies submitted to institutional ethics committee.

View Article and Find Full Text PDF

Background: Patients who are informed about the causes, pathophysiology, treatment and prevention of a disease are better able to participate in treatment procedures in the event of illness. Artificial intelligence (AI), which has gained popularity in recent years, is defined as the study of algorithms that provide machines with the ability to reason and perform cognitive functions, including object and word recognition, problem solving and decision making. This study aimed to examine the readability, reliability and quality of responses to frequently asked keywords about low back pain (LBP) given by three different AI-based chatbots (ChatGPT, Perplexity and Gemini), which are popular applications in online information presentation today.

View Article and Find Full Text PDF

Alzheimer's disease (AD) is a multifactorial pathology, responsible for neurodegenerative disorders which in more than 60% of patients evolve into dementia. Comprehension of the molecular mechanisms underlying the pathology and the development of reliable diagnostic methods have made new and more effective therapies possible. In recent years, in addition to the classic anticholinesterases (AChEs), which can control the clinical symptoms of the disease, compounds able to reduce deposits of amyloid-β (Aβ) and/or tau (τ) protein aggregates, which are disease-modifying therapeutics (DMTs), have been studied.

View Article and Find Full Text PDF

Websites parents' access for information regarding their child's chronic lower limb pain: A qualitative study.

Patient Educ Couns

January 2025

School of Primary and Allied Health Care, Monash University, VIC, Australia; Department of Health Sciences, Faculty of Medicine, Health and Humans Sciences, Macquarie University, NSW, Australia. Electronic address:

Objective: To explore the parent experience of finding information on websites to support their child with chronic lower limb pain and explore the quality of information available on those websites.

Methods: Parents of children with chronic lower limb pain conducted real-time searching of websites followed by semi-structured interviews via Zoom. Interviews were recorded, transcribed verbatim, and analysed thematically using an inductive approach.

View Article and Find Full Text PDF

Bibliometric analysis of global research trends in vestibular neuritis (1980-2024).

Eur Arch Otorhinolaryngol

January 2025

Faculty of Applied Sciences, Department of Accounting and Financial Management, Necmettin Erbakan University, Konya, Turkey.

Purpose: Vestibular neuritis (VN) is a common cause of vertigo with significant impact on patients' quality of life. This study aimed to analyze global research trends in VN using bibliometric methods to identify key themes, influential authors, institutions, and countries contributing to the field.

Methods: We conducted a comprehensive search of the Web of Science Core Collection database for publications related to VN from 1980 to 2024.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!