Beyond rating scales: With targeted evaluation, large language models are poised for psychological assessment.

Psychiatry Res

Psychology Department, Lund University, Sweden; Computer Science Department, Stony Brook University, United States.

Published: March 2024

In this narrative review, we survey recent empirical evaluations of AI-based language assessments and present a case for the technology of large language models to be poised for changing standardized psychological assessment. Artificial intelligence has been undergoing a purported "paradigm shift" initiated by new machine learning models, large language models (e.g., BERT, LAMMA, and that behind ChatGPT). These models have led to unprecedented accuracy over most computerized language processing tasks, from web searches to automatic machine translation and question answering, while their dialogue-based forms, like ChatGPT have captured the interest of over a million users. The success of the large language model is mostly attributed to its capability to numerically represent words in their context, long a weakness of previous attempts to automate psychological assessment from language. While potential applications for automated therapy are beginning to be studied on the heels of chatGPT's success, here we present evidence that suggests, with thorough validation of targeted deployment scenarios, that AI's newest technology can move mental health assessment away from rating scales and to instead use how people naturally communicate, in language.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.psychres.2023.115667DOI Listing

Publication Analysis

Top Keywords

large language
16
language models
12
psychological assessment
12
rating scales
8
language
8
models poised
8
models
5
scales targeted
4
targeted evaluation
4
large
4

Similar Publications

Motivation: The knowledge of protein stability upon residue variation is an important step for functional protein design and for understanding how protein variants can promote disease onset. Computational methods are important to complement experimental approaches and allow a fast screening of large datasets of variations.

Results: In this work we present DDGemb, a novel method combining protein language model embeddings and transformer architectures to predict protein ΔΔG upon both single- and multi-point variations.

View Article and Find Full Text PDF

The potential of large language models (LLMs) in medical applications is significant, and Retrieval-augmented generation (RAG) can address the weaknesses of these models in terms of data transparency and scientific accuracy by incorporating current scientific knowledge into responses. In this study, RAG and GPT-4 by OpenAI were applied to develop GuideGPT, a context aware chatbot integrated with a knowledge database from 449 scientific publications designed to provide answers on the prevention, diagnosis, and treatment of medication-related osteonecrosis of the jaw (MRONJ). A comparison was made with a generic LLM ("PureGPT") across 30 MRONJ-related questions.

View Article and Find Full Text PDF

The Potential Role of Speech Rate as an Etiologic Factor in Dysphonia.

J Voice

January 2025

Department of Speech Therapy, School of Rehabilitation, Tehran University of Medical Sciences, Tehran, Iran. Electronic address:

Objectives/hypothesis: Speech rate is deemed as one of the contributing factors in dysphonia. This study sought out if dysphonic patients speak faster than their normal counterparts. Also, the effects of dysphonia subtype (organic, functional, and neurologic), sex, and age on speech rate were investigated.

View Article and Find Full Text PDF

Background: Communication barriers are known to adversely affect patient safety. Yet few health systems assess and track physician non-English language proficiency for use in clinical settings. Barriers to current assessments (usually simulated clinician oral proficiency interviews) include time constraints and lack of interactivity.

View Article and Find Full Text PDF

Harnessing NLP to Investigate Biomarker Interactions and CVD Risks in Elderly Chronic Kidney Disease Patients.

SLAS Technol

January 2025

Department of General Medicine, The First Afiliated Hospital of Jinan University, Guangzhou, Guangdong, 510000, China. Electronic address:

Chronic kidney disease (CKD) significantly increases the risk of CVD diseases, particularly among elderly patients. Understanding the interaction between several biomarkers and cardiovascular (CVD) risks is crucial for improving patient outcomes and tailoring personalized treatment strategies. There is much more to learn about the intricate relationship between biomarkers and CVD risks in elderly CKD patients.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!