Combined perception of emotion in pictures and musical sounds.

Brain Res

Institute of Music Physiology and Musicians' Medicine, University of Music and Drama, Hannover, Hohenzollernstr. 47, D-30161 Hannover, Germany.

Published: January 2006

AI Article Synopsis

  • The study explores how our brains process emotional information from both visual (pictures) and auditory (songs) sources simultaneously, focusing on the integration of these different modalities.
  • It uses event-related potential (ERP) recordings to see how participants' attention affects their response to emotional content in either one of the modalities while ignoring the other.
  • Results show that emotional congruity (matching emotions) notably influenced the brain's electrical activity, with strong effects observed when participants rated pictures, particularly during happy visual and auditory pairs, and less influence when rating the auditory content.

Article Abstract

Evaluation of emotional scenes requires integration of information from different modality channels, most frequently from audition and vision. Neither the psychological nor neural basis of auditory-visual interactions during the processing of affect is well understood. In this study, possible interactions in affective processing were investigated via event-related potential (ERP) recordings during simultaneous presentation of affective pictures (from IAPS) and affectively sung notes that either matched or mismatched each other in valence. To examine the role of attention in multisensory affect-integration ERPs were recorded in two different rating tasks (voice affect rating, picture affect rating) as participants evaluated the affect communicated in one of the modalities, while that in the other modality was ignored. Both the behavioral and ERP data revealed some, although non-identical, patterns of cross-modal influences; modulation of the ERP-component P2 suggested a relatively early integration of affective information in the attended picture condition, though only for happy picture-voice pairs. In addition, congruent pairing of sad pictures and sad voice stimuli affected the late positive potential (LPP). Responses in the voice affect rating task were overall more likely to be modulated by the concomitant picture's affective valence than vice versa.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.brainres.2005.11.075DOI Listing

Publication Analysis

Top Keywords

affect rating
12
voice affect
8
affect
5
combined perception
4
perception emotion
4
emotion pictures
4
pictures musical
4
musical sounds
4
sounds evaluation
4
evaluation emotional
4

Similar Publications

Clinical Manifestations.

Alzheimers Dement

December 2024

Ministry of Health, São Paulo, 04207000, Brazil.

Background: Neuropsychiatric symptoms (NPS) are core features of AD and depression is a common co-morbidity in people with AD, affecting overall outcomes and decreasing quality of life.

Method: 205 outpatients with the diagnosis of AD conforming criteria proposed by NINCDS-ADRDA (2011), followed-up at a public university hospital, had their Geriatrics Depression Scale - 15 (GDS -15) and MMSE scores evaluated.

Results: 125 patients (60,97%) were diagnosed with depression and 80 patients (39,03%) were not diagnosed with depression.

View Article and Find Full Text PDF

Basic Science and Pathogenesis.

Alzheimers Dement

December 2024

Memory & Aging Center, Department of Neurology, University of California in San Francisco, San Francisco, CA, USA.

Background: Frontotemporal lobar degeneration (FTLD)- TAR DNA-binding protein 43 (TDP) type C is commonly associated with a clinical diagnosis of semantic dementia (SD). Although anterior temporal lobe (ATL) is one of the primary atrophy centers, it is yet to be defined which other areas are involved in the TDP-type C pathology early in the disease course.

Methods: We included 16 patients with autopsy-confirmed FTLD-TDP type C from the database of the UCSF Memory and Aging Center: 13 patients with semantic variant primary progressive aphasia (svPPA) and predominant left ATL atrophy, and 3 patients with semantic behavioral variant frontotemporal dementia (sbvFTD) and predominant right ATL atrophy.

View Article and Find Full Text PDF

Clinical Manifestations.

Alzheimers Dement

December 2024

Division of Neurology, Krembil Neuroscience Centre, Toronto Western Hospital, University Health Network Memory Clinic, Toronto, ON, Canada.

Background: The Clinical Dementia Rating Sum of Boxes (CDR-SB) is a widely used measurement score to stage dementia severity; it has become one of the most common outcome measurements in Alzheimer's Disease (AD) research. The CDR-SB requires an informant to provide information to stage a patient's dementia severity. The effect of the informant's characteristics including sex and relationship with patients on the CDR-SB is unknown.

View Article and Find Full Text PDF

Clinical Manifestations.

Alzheimers Dement

December 2024

Toronto Western Hospital, University Health Network, Toronto, ON, Canada.

Background: Depression affects individuals across various ages but is of significance in the older surgical population due to its adverse impact on cognitive function, surgical recovery, and overall functional disability. This study aimed to determine the overall prevalence and trajectory of depression in older surgical patients preoperatively, and at 30-, 90- and 180-days postoperatively.

Method: This study is a prespecified sub-study and analysis of the Postoperative Functional Disability in Unrecognized Cognitive Impairment Study.

View Article and Find Full Text PDF

Background: AD related pathologies, such as beta-amyloid (Aβ) and phosphorylated tau (pTau), are evident decades before any noticeable decline in memory occurs. Identifying individuals during this asymptomatic phase is crucial for timely intervention. The Mnemonic Similarity Task (MST), a modified recognition memory task, is especially relevant for early AD screening, as it assesses hippocampal integrity, a region affected (both directly and indirectly) early in the progression of the disease.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!