Neurocomputational mechanisms underlying cross-modal associations and their influence on perceptual decisions.

When exposed to complementary features of information across sensory modalities, our brains formulate cross-modal associations between features of stimuli presented separately to multiple modalities. For example, auditory pitch-visual size associations map high-pitch tones with small-size visual objects, and low-pitch tones with large-size visual objects. Preferential, or congruent, cross-modal associations have been shown to affect behavioural performance, i.

Neural correlates of multisensory reliability and perceptual weights emerge at early latencies during audio-visual integration.

To make accurate perceptual estimates, observers must take the reliability of sensory information into account. Despite many behavioural studies showing that subjects weight individual sensory cues in proportion to their reliabilities, it is still unclear when during a trial neuronal responses are modulated by the reliability of sensory information or when they reflect the perceptual weights attributed to each sensory input. We investigated these questions using a combination of psychophysics, EEG-based neuroimaging and single-trial decoding.

Illusory Increases in Font Size Improve Letter Recognition.

Visual performance of human observers depends not only on the optics of the eye and early sensory encoding but also on subsequent cortical processing and representations. In two experiments, we demonstrated that motion adaptation can enhance as well as impair visual acuity. Observers who experienced an expanding motion aftereffect exhibited improved letter recognition, whereas observers who experienced a contracting motion aftereffect showed impaired letter recognition.