As one of the facial expression recognition techniques for Head-Mounted Display (HMD) users, embedded photo-reflective sensors have been used. In this paper, we investigate how gaze and face directions affect facial expression recognition using the embedded photo-reflective sensors. First, we collected a dataset of five facial expressions (Neutral, Happy, Angry, Sad, Surprised) while looking in diverse directions by moving 1) the eyes and 2) the head. Using the dataset, we analyzed the effect of gaze and face directions by constructing facial expression classifiers in five ways and evaluating the classification accuracy of each classifier. The results revealed that the single classifier that learned the data for all gaze points achieved the highest classification performance. Then, we investigated which facial part was affected by the gaze and face direction. The results showed that the gaze directions affected the upper facial parts, while the face directions affected the lower facial parts. In addition, by removing the bias of facial expression reproducibility, we investigated the pure effect of gaze and face directions in three conditions. The results showed that, in terms of gaze direction, building classifiers for each direction significantly improved the classification accuracy. However, in terms of face directions, there were slight differences between the classifier conditions. Our experimental results implied that multiple classifiers corresponding to multiple gaze and face directions improved facial expression recognition accuracy, but collecting the data of the vertical movement of gaze and face is a practical solution to improving facial expression recognition accuracy.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1109/TVCG.2022.3179766 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Explainable human-centered traits from head motion and facial expression dynamics.
PLoS One
January 2025
Faculty of Science and Technology, University of Canberra, Canberra, ACT, Australia.
We explore the efficacy of multimodal behavioral cues for explainable prediction of personality and interview-specific traits. We utilize elementary head-motion units named kinemes, atomic facial movements termed action units and speech features to estimate these human-centered traits. Empirical results confirm that kinemes and action units enable discovery of multiple trait-specific behaviors while also enabling explainability in support of the predictions.
View Article and Find Full Text PDFNeural mechanisms underlying the interactive exchange of facial emotional expressions.
Soc Cogn Affect Neurosci
January 2025
Department of Psychology, Clinical Psychology and Psychotherapy, Regensburg University.
Facial emotional expressions are crucial in face-to-face social interactions, and recent findings have highlighted their interactive nature. However, the underlying neural mechanisms remain unclear. This EEG study investigated whether the interactive exchange of facial expressions modulates socio-emotional processing.
View Article and Find Full Text PDFA facial expression recognition network using hybrid feature extraction.
PLoS One
January 2025
Xinjiang Institute of Technology, Aksu, China.
Facial expression recognition faces great challenges due to factors such as face similarity, image quality, and age variation. Although various existing end-to-end Convolutional Neural Network (CNN) architectures have achieved good classification results in facial expression recognition tasks, these network architectures share a common drawback that the convolutional kernel can only compute the correlation between elements of a localized region when extracting expression features from an image. This leads to difficulties for the network to explore the relationship between all the elements that make up a complete expression.
View Article and Find Full Text PDFHistological and Molecular Manifestations of Cleft Myopathy.
Cleft Palate Craniofac J
January 2025
State Key Laboratory of Oral Diseases & National Center for Stomatology & National Clinical Research Center for Oral Diseases & West China Hospital of Stomatology, Sichuan University, Chengdu, China.
Objective: Apart from rupture and displacement of muscle fibers, structural defects exist in cleft muscles but have not been adequately investigated. This study aimed to examine the histological and molecular features of the cleft muscles.
Design: Orbicularis oris (OO) and tensor fasciae latae (TFL) muscle samples were obtained from patients with cleft lip and alveolar.
Clinical and imaging spectrum of non-congenital dominant ACTN2 myopathy.
J Neurol
January 2025
Department of Neurology and Neurosciences, Donostia University Hospital, Biogipuzkoa Health Research Institute, Donostia-San Sebastián, Spain.
Background: Alpha-actinin-2, a protein with high expression in cardiac and skeletal muscle, is located in the Z-disc and plays a key role in sarcomere stability. Mutations in ACTN2 have been associated with both hypertrophic and dilated cardiomyopathy and, more recently, with skeletal myopathy.
Methods: Genetic, clinical, and muscle imaging data were collected from 37 patients with an autosomal dominant ACTN2 myopathy belonging to 11 families from Spain and Belgium.
Want AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!