Human feelings expressed through verbal (e.g. voice) and non-verbal communication channels (e.g. face or body) can influence either human actions or interactions. In the literature, most of the attention was given to facial expressions for the analysis of emotions conveyed through non-verbal behaviors. Despite this, psychology highlights that the body is an important indicator of the human affective state in performing daily life activities. Therefore, this paper presents a novel method for affective action and interaction recognition from videos, exploiting multi-view representation learning and only full-body handcrafted characteristics selected following psychological and proxemic studies. Specifically, 2D skeletal data are extracted from RGB video sequences to derive diverse low-level skeleton features, i.e. multi-views, modeled through the bag-of-visual-words clustering approach generating a condition-related codebook. In this way, each affective action and interaction within a video can be represented as a frequency histogram of codewords. During the learning phase, for each affective class, training samples are used to compute its global histogram of codewords stored in a database and later used for the recognition task. In the recognition phase, the video frequency histogram representation is matched against the database of class histograms and classified as the closest affective class in terms of Euclidean distance. The effectiveness of the proposed system is evaluated on a specifically collected dataset containing 6 emotion for both actions and interactions, on which the proposed system obtains 93.64% and 90.83% accuracy, respectively. In addition, the devised strategy also achieves in line performances with other literature works based on deep learning when tested on a public collection containing 6 emotions plus a neutral state, demonstrating the effectiveness of the presented approach and confirming the findings in psychological and proxemic studies.
Download full-text PDF |
Source |
---|---|
http://dx.doi.org/10.1142/S012906572250040X | DOI Listing |
Cogn Neurodyn
December 2025
International research center for Cognitive Applied Neuroscience (IrcCAN), Università Cattolica del Sacro Cuore, Milan, Italy.
The metacognition of one's planning strategy constitutes a "second-level" of metacognition that goes beyond the knowledge and monitoring of one's cognition and refers to the ability to use awareness mechanisms to regulate execution of present or future actions effectively. This study investigated the relation between metacognition of one's planning strategy and the behavioral and electrophysiological (EEG) correlates that support strategic planning abilities during performance in a complex decision-making task. Moreover, a possible link between task execution, metacognition, and individual differences (i.
View Article and Find Full Text PDFNat Commun
January 2025
Department of Pharmacology and Therapeutics, Florida Chemical Senses Institute, Center for Addiction Research and Education; University of Florida College of Medicine, Gainesville, FL, USA.
Sniffing is a motivated behavior displayed by nearly all terrestrial vertebrates. While sniffing is associated with acquiring and processing odors, sniffing is also intertwined with affective and motivated states. The systems which influence the display of sniffing are unclear.
View Article and Find Full Text PDFBrain Res
December 2024
Drug Design and Pharmacology, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen 2100, Denmark. Electronic address:
Psychedelics show promise in treating psychiatric disorders. Therapeutic effects appear to involve activation of the 5-Hydroxytryptamine 2A receptor (5-HTR), a G protein-coupled receptor (GPCR). Several SNPs of the 5-HTR naturally occur, which are associated with differences in receptor function and altered responsiveness to treatments.
View Article and Find Full Text PDFHorm Behav
December 2024
Department of Psychology, University at Buffalo, SUNY, Buffalo, NY, USA; Neuroscience Program, University at Buffalo, SUNY, Buffalo, NY, USA; Evolution, Ecology, and Behavior Program, University at Buffalo, SUNY, NY, USA.
Anxiety is among the most prevalent mental health issues in children. While it is well established that gonadal steroids influence anxiety-like behavior in adulthood, a potential role in prepubertal juveniles has been overlooked because it is commonly thought that the gonads are quiescent during the juvenile period. However, the juvenile gonads secrete measurable amounts of steroids, and we have recently found that prepubertal ovariectomy decreases anxiety-like behavior of juvenile Siberian hamsters in the light/dark box test.
View Article and Find Full Text PDFSci Rep
December 2024
Department of Neurologic Surgery, Mayo Clinic, Rochester, MN, 55905, USA.
Alcohol use disorder (AUD) is a chronic relapsing brain disorder characterized by an impaired ability to stop or control alcohol consumption despite adverse social, occupational, or health consequences. AUD affects nearly one-third of adults at some point during their lives, with an associated cost of approximately $249 billion annually in the U.S.
View Article and Find Full Text PDFEnter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!