Mild cognitive impairment detection from facial video interviews by applying spatial-to-temporal attention module.

Expert Syst Appl

Department of Electrical and Computer Engineering, University of Denver, Denver 80208, CO, United States.

Published: October 2024

Early detection of Mild Cognitive Impairment (MCI) leads to early interventions to slow the progression from MCI into dementia. Deep Learning (DL) algorithms could help achieve early non-invasive and low-cost detection of MCI. This paper presents the detection of MCI in older adults using DL models based only on facial features extracted from video-recorded conversations at home. We used the data collected from the I-CONECT behavioral intervention study (NCT02871921), where several sessions of semi-structured interviews between socially isolated older individuals and interviewers were video recorded. We develop a framework that extracts holistic spatial facial features using a convolutional autoencoder and temporal information using transformers. We proposed the Spatial-to-Temporal Attention Module (STAM) to detect the I-CONECT study participants' cognitive conditions (MCI vs. those with normal cognition (NC)) using facial and interaction features. The interaction features of the facial features improved the prediction performance compared with applying facial features solely. The detection accuracy using this combined method reached 88%, whereas the accuracy without applying the segments and sequences information of the facial features within a video on a certain theme was 84%. Overall, the results show that spatiotemporal facial features modeled using DL algorithms have a discriminating power for the detection of MCI.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11174143PMC
http://dx.doi.org/10.1016/j.eswa.2024.124185DOI Listing

Publication Analysis

Top Keywords

facial features
24
detection mci
12
mild cognitive
8
cognitive impairment
8
facial
8
spatial-to-temporal attention
8
attention module
8
features
8
interaction features
8
detection
6

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!