Perceptual Inference, Learning, and Attention in a Multisensory World.

Annu Rev Neurosci

Donders Institute for Brain, Cognition and Behavior, Radboud University, 6525 AJ Nijmegen, The Netherlands; email:

Published: July 2021

Adaptive behavior in a complex, dynamic, and multisensory world poses some of the most fundamental computational challenges for the brain, notably inference, decision-making, learning, binding, and attention. We first discuss how the brain integrates sensory signals from the same source to support perceptual inference and decision-making by weighting them according to their momentary sensory uncertainties. We then show how observers solve the binding or causal inference problem-deciding whether signals come from common causes and should hence be integrated or else be treated independently. Next, we describe the multifarious interplay between multisensory processing and attention. We argue that attentional mechanisms are crucial to compute approximate solutions to the binding problem in naturalistic environments when complex time-varying signals arise from myriad causes. Finally, we review how the brain dynamically adapts multisensory processing to a changing world across multiple timescales.

Download full-text PDF

Source
http://dx.doi.org/10.1146/annurev-neuro-100120-085519DOI Listing

Publication Analysis

Top Keywords

perceptual inference
8
inference decision-making
8
multisensory processing
8
inference learning
4
learning attention
4
multisensory
4
attention multisensory
4
multisensory adaptive
4
adaptive behavior
4
behavior complex
4

Similar Publications

Object pose estimation is essential for computer vision applications such as quality inspection, robotic bin picking, and warehouse logistics. However, this task often requires expensive equipment such as 3D cameras or Lidar sensors, as well as significant computational resources. Many state-of-the-art methods for 6D pose estimation depend on deep neural networks, which are computationally demanding and require GPUs for real-time performance.

View Article and Find Full Text PDF

Numerate adults know that when two sets are equal, they should be labeled by the same number word. We explored the development of this principle-sometimes called "cardinal extension"-and how it relates to children's other numerical abilities. Experiment 1 revealed that 2- to 5-year-old children who could accurately count large sets often inferred that two equal sets should be labeled with the same number word, unlike children who could not accurately count large sets.

View Article and Find Full Text PDF

Perception integrates external sensory signals with internal predictions that reflect prior knowledge about the world. Previous research suggests that this integration is governed by slow alternations between an external mode, driven by sensory signals, and an internal mode, shaped by prior knowledge. Using a double-blind, placebo-controlled, cross-over experiment in healthy human participants, we investigated the effects of the N-Methyl-D-aspartate receptor (NMDAR) antagonist S-ketamine on the balance between external and internal modes.

View Article and Find Full Text PDF

Recent studies have suggested that autistic perception can be attributed to atypical Bayesian inference; however, it remains unclear whether the atypical Bayesian inference originates in the perceptual or post-perceptual stage or both. This study examined serial dependence in orientation at the perceptual and response stages in autistic and neurotypical adult groups. Participants comprised 17 autistic and 23 neurotypical adults.

View Article and Find Full Text PDF

The classical view is that perceptual attunement to the native language, which emerges by 6-10 months, developmentally precedes phonological feature abstraction abilities. That assumption is challenged by findings from adults adopted into a new language environment at 3-5 months that imply they had already formed phonological feature abstractions about their birth language prior to 6 months. As phonological feature abstraction had not been directly tested in infants, we examined 4-6-month-olds' amodal abstraction of the labial versus coronal place of articulation distinction between consonants.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!