Do Deepfakes Adequately Display Emotions? A Study on Deepfake Facial Emotion Expression.

Comput Intell Neurosci

Department of Computer Science and Engineering, Universitat de Lleida, Lleida, Spain.

Published: October 2022

Recent technological advancements in Artificial Intelligence make it easy to create deepfakes and hyper-realistic videos, in which images and video clips are processed to create fake videos that appear authentic. Many of them are based on swapping faces without the consent of the person whose appearance and voice are used. As emotions are inherent in human communication, studying how deepfakes transfer emotional expressions from original to fakes is relevant. In this work, we conduct an in-depth study on facial emotional expression in deepfakes using a well-known face swap-based deepfake database. Firstly, we extracted the photograms from their videos. Then, we analyzed the emotional expression in the original and faked versions of video recordings for all performers in the database. Results show that emotional expressions are not adequately transferred between original recordings and the deepfakes created from them. High variability in emotions and performers detected between original and fake recordings indicates that performer emotion expressiveness should be considered for better deepfake generation or detection.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC9596270PMC
http://dx.doi.org/10.1155/2022/1332122DOI Listing

Publication Analysis

Top Keywords

emotional expressions
8
emotional expression
8
deepfakes
5
deepfakes adequately
4
adequately display
4
display emotions?
4
emotions? study
4
study deepfake
4
deepfake facial
4
facial emotion
4

Similar Publications

Introduction: Home care workers (HCWs) are paid caregivers who provide support to patients with chronic conditions and functional limitations. Additionally, they provide emotional support to patients and familial support. Although several qualitative studies have been conducted on HCWs, they focused more on studying prevalently the lived experiences about the workplace violence, the end of life, stressor and resilience, during the COVID-19 pandemic or focused more in dementia and heart failure, but not on feelings and working conditions.

View Article and Find Full Text PDF

Schizotypy is a multidimensional construct that is composed of positive, negative, and disorganized dimensions. Historically, disorganized schizotypy, which involves disruptions in thoughts, speech, behavior, and affect, has been relatively understudied and less clearly operationalized than the other dimensions. The present study employed experience sampling methodology to examine the associations of positive, negative, and disorganized schizotypy, as measured by the Multidimensional Schizotypy Scale, with daily life experiences.

View Article and Find Full Text PDF

Impairments in mentalizing, the capacity to understand the self and others in terms of intentional mental states, are proposed to play an important role in the emergence of borderline personality disorder (BPD) in adolescence. Although mentalizing problems in adults with BPD have been amply demonstrated, research in adolescence lags behind in terms of both the normative development of mentalizing in adolescence and the relation between different dimensions of mentalizing and adolescent BPD. Therefore, the current study investigated developmental trends and sex-related differences related to different mentalizing dimensions and the associations between mentalizing dimensions and BPD features in a large group of adolescents ( = 456, = 15.

View Article and Find Full Text PDF

A multitude of studies have supported that vital exhaustion is an important predictor of physical and psychological well-being, especially in the aftermath of adverse medical events; however, some authors have expressed that vital exhaustion may be repetitive with other popular constructs, namely burnout, fatigue, and depression. We resolve this tension by performing a meta-analysis of 74 sources on the immediate nomological network of vital exhaustion. Our results support that the relations of vital exhaustion with emotional exhaustion ( = 0.

View Article and Find Full Text PDF

Dominant narratives of solid-organ transplantation foreground vocabularies of gratitude. Solid-organ transplantation is often celebrated in biomedicine for its high-tech innovation and specialization. But transplantation also includes the organizations that oversee the distribution of donated organs to potential recipients who disproportionately outnumber available organs.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!