Our affective experiences are influenced by combined multisensory information. Although the enhanced effects of congruent audiovisual information on our affective experiences have been well documented, the role of neural oscillations in the audiovisual integration of affective signals remains unclear. First, it is unclear whether oscillatory activity changes as a function of valence. Second, the function of phase-locked and non-phase-locked power changes in audiovisual integration of affect has not yet been clearly distinguished. To fill this gap, the present study performed time-frequency analyses on EEG data acquired while participants perceived positive, neutral and negative naturalistic video and music clips. A comparison between the congruent audiovisual condition and the sum of unimodal conditions was used to identify supra-additive (Audiovisual > Visual + Auditory) or sub-additive (Audiovisual < Visual + Auditory) integration effects. The results showed that early evoked sub-additive theta and sustained induced supra-additive delta and beta activities are linked to audiovisual integration of affect regardless of affective content.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.biopsycho.2020.108006 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
The power of sound: Exploring the auditory influence on visual search efficiency.
Cognition
December 2024
School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian 116029, China; School of Foreign Languages, Ningbo University of Technology, Ningbo 315211, China. Electronic address:
In a dynamic visual search environment, a synchronous and meaningless auditory signal (pip) that corresponds with a change in a visual target promotes the efficiency of visual search (pop out), which is known as the pip-and-pop effect. We conducted three experiments to investigate the mechanism of the pip-and-pop effect. Using the eye movement technique, we manipulated the interval rhythm (Exp.
View Article and Find Full Text PDFNeural correlates of audiovisual integration in schizophrenia - an ERP study.
Front Psychiatry
December 2024
Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hannover, Germany.
Introduction: Multisensory integration (MSI) enhances perception by combining information from different sensory modalities. In schizophrenia, individuals often exhibit impaired audiovisual processing, resulting in broader temporal binding windows (TBWs) which appear to be associated with symptom severity. Since the underlying mechanisms of these aberrations are not yet fully understood, the present study aims to investigate multisensory processing in schizophrenia in more detail.
View Article and Find Full Text PDFCue modality modulates interaction between exogenous spatial attention and audiovisual integration.
Exp Brain Res
December 2024
Department of Psychology, Northeast Normal University, Changchun, People's Republic of China.
Exogenous spatial attention attenuates audiovisual integration (AVI). Previous studies on the effects of exogenous spatial attention on AVI have focused on the inhibition of return (IOR) effect induced by visual cues and the facilitation effect induced by auditory cues, but the differences between the effects of exogenous spatial attention (induced by visual and auditory cues) on AVI remain unclear. The present study used the exogenous spatial cue-target paradigm and manipulated cue stimulus modality (visual cue, auditory cue) in two experiments (Experiment 1: facilitation effect; Experiment 2: IOR effect) to examine the effects of exogenous spatial attention (evoked by cues in different modalities) on AVI.
View Article and Find Full Text PDFBehavioral Response Modeling to Resolve Listener- and Stimulus-Related Influences on Audiovisual Speech Integration in Cochlear Implant Users.
Ear Hear
December 2024
Department of Psychology, University of Western Ontario, London, Ontario, Canada.
Objectives: Speech intelligibility is supported by the sound of a talker's voice and visual cues related to articulatory movements. The relative contribution of auditory and visual cues to an integrated audiovisual percept varies depending on a listener's environment and sensory acuity. Cochlear implant users rely more on visual cues than those with acoustic hearing to help compensate for the fact that the auditory signal produced by their implant is poorly resolved relative to that of the typically developed cochlea.
View Article and Find Full Text PDFThe Power of Trial History: How Previous Trial Shapes Audiovisual Integration.
Multisens Res
November 2024
Faculty of Interdisciplinary Science and Engineering in Health Systems, 12997Okayama University, Okayama, Japan.
Combining information from visual and auditory modalities to form a unified and coherent perception is known as audiovisual integration. Audiovisual integration is affected by many factors. However, it remains unclear whether the trial history can influence audiovisual integration.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!