Background: ChatGPT conversation system has ushered in a revolutionary new era of information retrieval and stands as one of the fastest-growing platforms. Clinical pharmacy, as a dynamic discipline, necessitates an advanced comprehension of drugs and diseases. The process of decision-making in clinical pharmacy demands accuracy and consistency in medical information, as it directly affects patient safety.
Objective: The objective was to evaluate ChatGPT's accuracy and consistency in managing pharmacotherapy cases across multiple time points. Additionally, input was gathered from global clinical pharmacy experts, and the agreement between ChatGPT's responses and those of clinical pharmacy experts worldwide was assessed.
Methods: A set of 20 cases of pharmacotherapy was entered into ChatGPT at three different time points. Reliability analysis was performed using inter-rater reliability to measure the accuracy of the output generated by ChatGPT at each time point. Test-retest reliability was performed to measure the consistency of the output generated by ChatGPT across the three time points. Pharmacy expert performance was evaluated, and the overall results were compared.
Results: ChatGPT achieved a hit rate of 70.83% at week 1, 79.2% at week 3, and 75% at week 5. The percent agreement between weeks 1 and 3 was 79.2%, whereas it was 87.5% between weeks 3 and 5, and 83.3% between weeks 1 and 5. In contrast, accuracy rates among clinical pharmacy experts showed considerable variation according to their geographic location. The highest agreement between clinical pharmacist responses and ChatGPT responses was observed at the last time point examined.
Conclusions: Overall, the analysis suggested that ChatGPT is capable of generating clinically relevant pharmaceutical information, albeit with some variation in accuracy and consistency. It should be noted that clinical pharmacy experts worldwide may provide varying degrees of accuracy depending on their expertise. This study highlights the potential of AI chatbots in clinical pharmacy.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.sapharm.2023.08.012 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Genomic sequencing in diverse and underserved pediatric populations: parent perspectives on understanding, uncertainty, psychosocial impact, and personal utility of results.
Genet Med
January 2025
Genomics Ethics, and Translational Research Program, RTI International, Research Triangle Park, NC; Department of Translational and Applied Genomics, Kaiser Permanente Center for Health Research, Portland, OR. Electronic address:
Purpose: Limited evidence evaluates parents' perceptions of their child's clinical genomic sequencing (GS) results, particularly among individuals from medically underserved groups. Five Clinical Sequencing Evidence-Generating Research (CSER) consortium studies performed GS in children with suspected genetic conditions with high proportions of individuals from underserved groups to address this evidence gap.
Methods: Parents completed surveys of perceived understanding, personal utility, and test-related distress after GS result disclosure.
Anti-arthritic potential of crude sulfated polysaccharide from marine macroalgae (Turner) C. Agardh: Regulation of cytokine cascade.
Biomol Concepts
January 2025
Division of Pharmacology, School of Medical and Life Sciences, Sunway University, No. 5, Jalan Universiti, Bandar Sunway, 47500 Selangor Darul Ehsan, Malaysia.
Seaweeds have been utilized as food, fodder, fertilizer, and medicine since ancient times; nevertheless, they have received only a little attention. In the current work, we extracted the sulfated polysaccharide from a marine source and investigated its anti-arthritic potential . The isolated and freeze-dried polysaccharide was tested for acute oral toxicity based on OECD 423.
View Article and Find Full Text PDFDNA2 knockout aggravates cerebral ischemia/reperfusion injury by reducing postsynaptic Homer1a.
Zool Res
January 2025
Research & Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen, Guangdong 518057, China.
DNA2, a multifunctional enzyme with structure-specific nuclease, 5 -to-3 helicase, and DNA-dependent ATPase activities, plays a pivotal role in the cellular response to DNA damage. However, its involvement in cerebral ischemia/reperfusion (I/R) injury remains to be elucidated. This study investigated the involvement of DNA2 in cerebral I/R injury using conditional knockout (cKO) mice ( -Cre) subjected to middle cerebral artery occlusion (MCAO), an established model of cerebral I/R.
View Article and Find Full Text PDFNEDD4-Mediated GSNOR Degradation Aggravates Cardiac Hypertrophy and Dysfunction.
Circ Res
January 2025
Key Laboratory of Drug Targets and Translational Medicine for Cardio-cerebrovascular Diseases, Key Laboratory of Targeted Intervention of Cardiovascular Disease, Collaborative Innovation Center for Cardiovascular Disease Translational Medicine, The Affiliated Suzhou Hospital of Nanjing Medical University, Suzhou Municipal Hospital, Gusu School, Nanjing Medical University, Jiangsu, China (X.T., X.L., X.S., Y. Zhang, Y. Zu, Q.F., L.H., S.S., F.C., L.X., Y.J.).
Background: The decrease in S-nitrosoglutathione reductase (GSNOR) leads to an elevation of S-nitrosylation, thereby exacerbating the progression of cardiomyopathy in response to hemodynamic stress. However, the mechanisms under GSNOR decrease remain unclear. Here, we identify NEDD4 (neuronal precursor cell expressed developmentally downregulated 4) as a novel molecule that plays a crucial role in the pathogenesis of pressure overload-induced cardiac hypertrophy, by modulating GSNOR levels, thereby demonstrating significant therapeutic potential.
View Article and Find Full Text PDFReductive Adjuvant Nanosystem for Alleviated Atopic Dermatitis Syndromes.
ACS Nano
January 2025
College of Pharmaceutical Sciences, Zhejiang University, 866 Yuhangtang Road, Hangzhou, Zhejiang 310058, P. R. China.
Atopic dermatitis (AD) is a recurrent and chronic inflammatory skin condition characterized by a high lifetime prevalence and significant impairment of patients' quality of life, primarily due to intense itching and discomfort. However, current pharmacological interventions provide only moderate efficacy and are frequently accompanied by adverse side effects. The immune-pathogenesis of AD involves dysregulation of the Th2 immune response and exacerbation of inflammation related to excessive reactive oxygen species (ROS).
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!