Face-to-face communication relies on the integration of acoustic speech signals with the corresponding facial articulations. In the McGurk illusion, an auditory /ba/ phoneme presented simultaneously with a facial articulation of a /ga/ (i.e., viseme), is typically fused into an illusory 'da' percept. Despite its widespread use as an index of audiovisual speech integration, critics argue that it arises from perceptual processes that differ categorically from natural speech recognition. Conversely, Bayesian theoretical frameworks suggest that both the illusory McGurk and the veridical audiovisual congruent speech percepts result from probabilistic inference based on noisy sensory signals. According to these models, the inter-sensory conflict in McGurk stimuli may only increase observers' perceptual uncertainty. This functional magnetic resonance imaging (fMRI) study presented participants (20 male and 24 female) with audiovisual congruent, McGurk (i.e., auditory /ba/ + visual /ga/), and incongruent (i.e., auditory /ga/ + visual /ba/) stimuli along with their unisensory counterparts in a syllable categorization task. Behaviorally, observers' response entropy was greater for McGurk compared to congruent audiovisual stimuli. At the neural level, McGurk stimuli increased activations in a widespread neural system, extending from the inferior frontal sulci (IFS) to the pre-supplementary motor area (pre-SMA) and insulae, typically involved in cognitive control processes. Crucially, in line with Bayesian theories these activation increases were fully accounted for by observers' perceptual uncertainty as measured by their response entropy. Our findings suggest that McGurk and congruent speech processing rely on shared neural mechanisms, thereby supporting the McGurk illusion as a valid measure of natural audiovisual speech perception.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10964917PMC
http://dx.doi.org/10.1002/hbm.26653DOI Listing

Publication Analysis

Top Keywords

perceptual uncertainty
12
audiovisual congruent
12
congruent speech
12
mcgurk stimuli
12
mcgurk
9
mcgurk illusion
8
audiovisual speech
8
observers' perceptual
8
response entropy
8
speech
7

Similar Publications

Individuals with autism spectrum condition (ASC) are suggested to experience difficulties with categorization and generalization. However, empirical studies have mainly focused on one process at a time, and neglected underlying neural mechanisms. Here, we investigated categorization and generalization at a behavioral and neural level in 38 autistic and 38 neurotypical (NT) adults.

View Article and Find Full Text PDF

Global precedence effect in fear generalization and the role of trait anxiety and intolerance of uncertainty.

Behav Res Ther

December 2024

Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, China; School of Psychology, Center for Studies of Psychological Application, and Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631, Guangzhou, China. Electronic address:

Fear overgeneralization is widely considered to be a core feature of pathological anxiety, and the excessive spread of fear can be a great burden on patients. Although perceptual processing is a basic process of human cognition, the impact of visual perception recognition on fear generalization has not yet been fully explored. In this study, 69 subjects were recruited to explore the effects of the hierarchical features of stimuli on fear generalization and examine the roles of trait anxiety (TA) and intolerance of uncertainty (IU) in this process.

View Article and Find Full Text PDF

A continuum from predictive to online feedback in visuomotor interception.

Eur J Neurosci

December 2024

Laboratorio de Plasticidad Cortical y Aprendizaje Perceptual, Instituto de Neurociencias, Universidad de Guadalajara, Guadalajara, Jalisco, Mexico.

Interception, essential for activities like driving and sports, can be characterized by varying degrees of predictive behaviour. We developed a visually guided task to explore how target predictability and visibility influenced interception actions. The task featured a falling dot influenced by horizontal velocity, gravity and air friction, with predictability manipulated through external forces that altered the target's trajectory.

View Article and Find Full Text PDF

: Persistent Postural-Perceptual Dizziness (PPPD) is a frequent diagnosis in patients with chronic dizziness, ineffective postural control, visual dependence, and emotional symptoms. : 53 patients with PPPD (25-84 years old) and 53 adults (29-84 years old) with no vestibular disease agreed to participate in this study. Assessments included: vestibular function tests (sinusoidal yaw rotation and vestibular-evoked myogenic potentials); accuracy and precision of Subjective Visual Vertical (SVV) estimation while static and during on-axis yaw rotation; static posturography with open/closed eyes and 30° neck extension, while standing on hard/soft surface; questionnaires on symptoms of unsteadiness, spatial anxiety, dizziness-related handicap, anxiety/depression, depersonalization/derealization, and perceived stress.

View Article and Find Full Text PDF

Stress carries diverse implications for perceptual, cognitive, and affective functions. One population particularly susceptible to acute stress-induced cognitive changes are individuals with high-stress jobs (e.g.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!