Using language models to identify relevant new information in inpatient clinical notes.

AMIA Annu Symp Proc

Institute for Health Informatics, University of Minnesota, Minneapolis, MN, USA ; Department of Surgery, University of Minnesota, Minneapolis, MN, USA.

Published: September 2015

Redundant information in clinical notes within electronic health record (EHR) systems is ubiquitous and may negatively impact the use of these notes by clinicians, and, potentially, the efficiency of patient care delivery. Automated methods to identify redundant versus relevant new information may provide a valuable tool for clinicians to better synthesize patient information and navigate to clinically important details. In this study, we investigated the use of language models for identification of new information in inpatient notes, and evaluated our methods using expert-derived reference standards. The best method achieved precision of 0.743, recall of 0.832 and F1-measure of 0.784. The average proportion of redundant information was similar between inpatient and outpatient progress notes (76.6% (SD=17.3%) and 76.7% (SD=14.0%), respectively). Advanced practice providers tended to have higher rates of redundancy in their notes compared to physicians. Future investigation includes the addition of semantic components and visualization of new information.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4419897PMC

Publication Analysis

Top Keywords

language models
8
clinical notes
8
notes
6
models identify
4
identify relevant
4
relevant inpatient
4
inpatient clinical
4
notes redundant
4
redundant clinical
4
notes electronic
4

Similar Publications

Background: Watching short videos is an integral part of the daily lives of young and middle-aged people. Nevertheless, the correlation between the screen time spent watching short videos at bedtime and essential hypertension in young and middle-aged people remains unclear. We aimed to explore the correlation between the screen time spent watching short videos at bedtime and essential hypertension among young and middle-aged people and construct a nomogram prediction model for assessing the probability of developing essential hypertension for these age groups.

View Article and Find Full Text PDF

The purpose of this study was to predict an academic achievement model based on cardiorespiratory fitness (CRF) and body mass index (BMI) in ninth-graders. The study sample included 6 530 adolescents from 341 public schools in Slovakia. Criterion-referenced competency tests measuring academic performance in mathematics and mother language (Slovak), CRF, and BMI were assessed in the academic year 2022-2023.

View Article and Find Full Text PDF

Adolescence is a developmental period of relative volatility, where the individual experiences significant changes to their physical and social environment. The ability to adapt to the volatility of one's surroundings is an important cognitive ability, particularly while foraging, a near-ubiquitous behaviour across the animal kingdom. As adolescents experience more volatility in their surroundings, we predicted that this age group would be more adept than adults at using exploration to adjust to volatility.

View Article and Find Full Text PDF

Using administrative claims and electronic health records for observational studies is common but challenging due to data limitations. Researchers rely on phenotype algorithms, requiring labor-intensive chart reviews for validation. This study investigates whether case adjudication using the previously introduced Knowledge-Enhanced Electronic Profile Review (KEEPER) system with large language models (LLMs) is feasible and could serve as a viable alternative to manual chart review.

View Article and Find Full Text PDF

Large language models (LLMs) are fundamentally transforming human-facing applications in the health and well-being domains: boosting patient engagement, accelerating clinical decision-making, and facilitating medical education. Although state-of-the-art LLMs have shown superior performance in several conversational applications, evaluations within nutrition and diet applications are still insufficient. In this paper, we propose to employ the Registered Dietitian (RD) exam to conduct a standard and comprehensive evaluation of state-of-the-art LLMs, GPT-4o, Claude 3.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!