Audio and visual speech emotion activate the left pre-supplementary motor area.

Cogn Affect Behav Neurosci

Department of Psychology, Ryerson University, Toronto, ON, M5B 2K3, Canada.

Published: April 2022

Sensorimotor brain areas have been implicated in the recognition of emotion expressed on the face and through nonverbal vocalizations. However, no previous study has assessed whether sensorimotor cortices are recruited during the perception of emotion in speech-a signal that includes both audio (speech sounds) and visual (facial speech movements) components. To address this gap in the literature, we recruited 24 participants to listen to speech clips produced in a way that was either happy, sad, or neutral in expression. These stimuli also were presented in one of three modalities: audio-only (hearing the voice but not seeing the face), video-only (seeing the face but not hearing the voice), or audiovisual. Brain activity was recorded using electroencephalography, subjected to independent component analysis, and source-localized. We found that the left presupplementary motor area was more active in response to happy and sad stimuli than neutral stimuli, as indexed by greater mu event-related desynchronization. This effect did not differ by the sensory modality of the stimuli. Activity levels in other sensorimotor brain areas did not differ by emotion, although they were greatest in response to visual-only and audiovisual stimuli. One possible explanation for the pre-SMA result is that this brain area may actively support speech emotion recognition by using our extensive experience expressing emotion to generate sensory predictions that in turn guide our perception.

Download full-text PDF

Source
http://dx.doi.org/10.3758/s13415-021-00961-2DOI Listing

Publication Analysis

Top Keywords

speech emotion
8
motor area
8
sensorimotor brain
8
brain areas
8
happy sad
8
hearing voice
8
emotion
6
speech
5
stimuli
5
audio visual
4

Similar Publications

Comprehension of acoustically degraded emotional prosody in Alzheimer's disease and primary progressive aphasia.

Sci Rep

December 2024

Dementia Research Centre, Department of Neurodegenerative Disease, UCL Queen Square Institute of Neurology, University College London, 1st Floor, 8-11 Queen Square, London, WC1N 3AR, UK.

Previous research suggests that emotional prosody perception is impaired in neurodegenerative diseases like Alzheimer's disease (AD) and primary progressive aphasia (PPA). However, no previous research has investigated emotional prosody perception in these diseases under non-ideal listening conditions. We recruited 18 patients with AD, and 31 with PPA (nine logopenic (lvPPA); 11 nonfluent/agrammatic (nfvPPA) and 11 semantic (svPPA)), together with 24 healthy age-matched individuals.

View Article and Find Full Text PDF

: Hearing loss is a highly prevalent condition in the world population that determines emotional, social, and economic costs. In recent years, it has been definitely recognized that the lack of physiological binaural hearing causes alterations in the localization of sounds and reduced speech recognition in noise and reverberation. This study aims to explore the psycho-social profile of adult workers affected by single-sided deafness (SSD), without other major medical conditions and otological symptoms, through comparison to subjects with normal hearing.

View Article and Find Full Text PDF

Objective: To evaluate the effectiveness of Royal Far West allied health telehealth services to support the health and well-being of children affected by the bushfires.

Setting: In response to the 2019/2020 Black Summer bushfires, Royal Far West (RFW) implemented the Community Recovery Services (CRS) targeting the health and well-being of affected children. One component of the CRS was the delivery of allied health telehealth services to children.

View Article and Find Full Text PDF

Given the ubiquitous nature of love, numerous theories have been proposed to explain its existence. One such theory refers to love as a commitment device, suggesting that romantic love evolved to foster commitment between partners and enhance their reproductive success. In the present study, we investigated this hypothesis using a large-scale sample of 86,310 individual responses collected across 90 countries.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!