What Does ChatGPT Know About Dementia? A Comparative Analysis of Information Quality.

J Alzheimers Dis

Department of Medicine, Division of Neurology, The University of British Columbia, Vancouver, British Columbia, Canada.

Published: January 2024

The quality of information about dementia retrieved using ChatGPT is unknown. Content was evaluated for length, readability, and quality using the QUEST, a validated tool, and compared against online material from three North American organizations. Both sources of information avoided conflicts of interest, supported the patient-physician relationship, and used a balanced tone. Official bodies but not ChatGPT referenced identifiable research and pointed to local resources. Users of ChatGPT are likely to encounter accurate but shallow information about dementia. Recommendations are made for information creators and providers who counsel patients around digital health practices.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10836539PMC
http://dx.doi.org/10.3233/JAD-230573DOI Listing

Publication Analysis

Top Keywords

chatgpt
4
chatgpt dementia?
4
dementia? comparative
4
comparative analysis
4
analysis quality
4
quality quality
4
quality dementia
4
dementia retrieved
4
retrieved chatgpt
4
chatgpt unknown
4

Similar Publications

ChatGPT Assisting Diagnosis of Neuro-Ophthalmology Diseases Based on Case Reports.

J Neuroophthalmol

October 2024

Department of Ophthalmology (YM, MD, PAL, JWF, TJH, SY), University of Tennessee Health Science Center, Memphis, Tennessee; Department of Ophthalmology (MYK), University of Colorado School of Medicine, Aurora, Colorado; and Department of Genetics, Genomics, and Informatics (SY), University of Tennessee Health Science Center, Memphis, Tennessee.

Background: To evaluate the accuracy of Chat Generative Pre-Trained Transformer (ChatGPT), a large language model (LLM), to assist in diagnosing neuro-ophthalmic diseases based on case reports.

Methods: We selected 22 different case reports of neuro-ophthalmic diseases from a publicly available online database. These cases included a wide range of chronic and acute diseases commonly seen by neuro-ophthalmic subspecialists.

View Article and Find Full Text PDF

Artificial Doctors: Performance of Chatbots as a Tool for Patient Education on Keratoconus.

Eye Contact Lens

December 2024

Department of Ophthalmology (Z.O.O.), Gaziantep State Hospital, Gaziantep, Turkey; Department of Ophthalmology (L.D.), Niğde Ömer Halisdemir University, Niğde, Turkey; and Department of Ophthalmology (I.E.Y.), Gaziantep Dr. Ersin Arslan Training and Research Hospital, Gaziantep, Turkey.

Purpose: We aimed to compare the answers given by ChatGPT, Bard, and Copilot and that obtained from the American Academy of Ophthalmology (AAO) website to patient-written questions related to keratoconus in terms of accuracy, understandability, actionability, and readability to find out whether chatbots can be used in patient education.

Methods: Twenty patient-written questions obtained from the AAO website related to keratoconus were asked to ChatGPT, Bard, and Copilot. Two ophthalmologists independently assessed the answers obtained from chatbots and the AAO website in terms of accuracy, understandability, and actionability according to the Structure of Observed Learning Outcome taxonomy, Patient Education Materials Assessment Tool-Understandability, and Patient Education Materials Assessment Tool-Actionability tests, respectively.

View Article and Find Full Text PDF

In the field of Japanese-Chinese translation linguistics, the issue of correctly translating attributive clauses has persistently proven to be challenging. Present-day machine translation tools often fail to accurately translate attributive clauses from Japanese to Chinese. In light of this, this paper investigates the linguistic problem underlying such difficulties, namely how does the semantic role of the modified noun affect the selection of translation patterns for attributive clauses, from a linguistic perspective.

View Article and Find Full Text PDF

Background: Chat Generative Pre-trained Transformer (ChatGPT) is a 175-billion-parameter natural language processing model that uses deep learning algorithms trained on vast amounts of data to generate human-like texts such as essays. Consequently, it has introduced new challenges and threats to medical education. We assessed the use of ChatGPT and other AI tools among medical students in Uganda.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!