Objective: AI-derived language models are booming, and their place in medicine is undefined. The aim of our study is to compare responses to andrology clinical cases, between chatbots and andrologists, to assess the reliability of these technologies.
Material And Method: We analyzed the responses of 32 experts, 18 residents and three chatbots (ChatGPT v3.5, v4 and Bard) to 25 andrology clinical cases. Responses were assessed on a Likert scale ranging from 0 to 2 for each question (0-false response or no response; 1-partially correct response, 2- correct response), on the basis of the latest national or, in the absence of such, international recommendations. We compared the averages obtained for all cases by the different groups.
Results: Experts obtained a higher mean score (m=11/12.4 σ=1.4) than ChatGPT v4 (m=10.7/12.4 σ=2.2, p=0.6475), ChatGPT v3.5 (m=9.5/12.4 σ=2.1, p=0.0062) and Bard (m=7.2/12.4 σ=3.3, p<0.0001). Residents obtained a mean score (m=9.4/12.4 σ=1.7) higher than Bard (m=7.2/12.4 σ=3.3, p=0.0053) but lower than ChatGPT v3.5 (m=9.5/12.4 σ=2.1, p=0.8393) and v4 (m=10.7/12.4 σ=2.2, p=0.0183) and experts (m=11.0/12.4 σ=1.4,p=0.0009). ChatGPT v4 performance (m=10.7 σ=2.2) was better than ChatGPT v3.5 (m=9.5, σ=2.1, p=0.0476) and Bard performance (m=7.2 σ=3.3, p<0.0001).
Conclusion: The use of chatbots in medicine could be relevant. More studies are needed to integrate them into clinical practice.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.fjurol.2024.102636 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Epidemiological characteristics of elderly osteoporosis fractures and their association with air pollutants: a multi-center study in Hebei Province.
Sci Rep
December 2024
Hebei Provincial Key Laboratory of Orthopaedic Biomechanics, Hebei Orthopaedic Research Institute, No. 139 Ziqiang Road, Shijiazhuang, 050051, China.
To investigate the population distribution characteristics of elderly osteoporosis fracture patients in Hebei Province and analyze the effects of air pollutants on elderly osteoporosis fractures, We retrospectively collected 18,933 cases of elderly osteoporosis fractures from January 1, 2019, to December 31, 2022, from four hospitals in Hebei Province. The average age was 76.44 ± 7.
View Article and Find Full Text PDFIntravenous sedation for adults with profound acquired brain injury undergoing dental treatment - a seven-year service evaluation.
BDJ Open
December 2024
Consultant in Special Care Dentistry, Surrey and Sussex NHS Health Care Trust, Redhill, UK.
Background: Dental treatment may not be possible for patients with a profound acquired brain injury without pharmacological support. Intravenous (IV) sedation with midazolam is a widely accepted, safe, and effective mode of treatment for people with a disability, but there is limited evidence in this patient cohort.
Aims: This evaluation aimed to review the IV sedation service for patients with profound acquired brain injury within the dental department at the Royal Hospital for Neuro-disability.
Mortality in Haemophilia Patients in India: A National Cohort Study.
Haemophilia
December 2024
Advanced Center for Oncology, Hematology and Rare Disorders (ACOHRD), K.J. Somaiya Super Speciality Hospital & Research Center, Somaiya Ayurvihar, Sion East, Mumbai, Maharashtra, India.
Introduction: Mortality and morbidity in persons with haemophilia (PWH) have decreased due to improved diagnosis and treatment along with comprehensive population outreach efforts, but the impact is not uniform in different countries.
Aim: The study aims to assess all-cause and intracranial haemorrhage (ICH)-specific mortality of PWH in India.
Methods: This is a retrospective, observational, multi-centric cohort study of 1020 haemophilia patients from three centres in India.
Adiposity and risks of gastrointestinal cancers: A 10-year prospective study of 0.5 million Chinese adults.
Int J Cancer
December 2024
Clinical Trial Service Unit and Epidemiological Studies Unit (CTSU), Nuffield Department of Population Health, University of Oxford, Oxford, UK.
Associations of adiposity with risks of oesophageal squamous cell carcinoma (ESCC) and non-cardia stomach cancer, both prevalent in China, are still inconclusive. While adiposity is an established risk factor for colorectal cancer, the relevance of fat-free mass and early-adulthood adiposity remains to be explored. The prospective China Kadoorie Biobank study included 0.
View Article and Find Full Text PDFExpanding molecular and clinical spectrum of CPT1C-associated hereditary spastic paraplegia (SPG73)-a case series.
Ann Clin Transl Neurol
December 2024
Department of Neurology, Movement Disorders Program, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Autosomal-dominant variants in the CPT1C gene have been associated with hereditary spastic paraplegia type 73 (SPG73), which typically presents with slowly progressive lower limb weakness and spasticity and is therefore considered a pure form of hereditary spastic paraplegia. However, we report two unrelated males with novel CPT1C variants (NM_001199753.2: patient 1: c.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!