Brain imaging and electrophysiological markers of anaphoric reference during speech production.

Pronouns create cohesive links in discourse by referring to previously mentioned elements. Here, we focus on pronominalization during speech production in three experiments employing ERP and fMRI methodologies. Participants were asked to produce two short sentences describing a man or woman using an object.

Illusory tactile movement crosses arms and legs and is coded in external space.

Humans often misjudge where on the body a touch occurred. Theoretical accounts have ascribed such misperceptions to local interactions in peripheral and primary somatosensory neurons, positing that spatial-perceptual mechanisms adhere to limb boundaries and skin layout. Yet, perception often reflects integration of sensory signals with prior experience.

Infants are superior in implicit crossmodal learning and use other learning mechanisms than adults.

During development internal models of the sensory world must be acquired which have to be continuously adapted later. We used event-related potentials (ERP) to test the hypothesis that infants extract crossmodal statistics implicitly while adults learn them when task relevant. Participants were passively exposed to frequent standard audio-visual combinations (A1V1, A2V2, p=0.

Experience with crossmodal statistics reduces the sensitivity for audio-visual temporal asynchrony.

Bayesian models propose that multisensory integration depends on both sensory evidence (the likelihood) and priors indicating whether or not two inputs belong to the same event. The present study manipulated the prior for dynamic auditory and visual stimuli to co-occur and tested the predicted enhancement of multisensory binding as assessed with a simultaneity judgment task. In an initial learning phase participants were exposed to a subset of auditory-visual combinations.

Neural basis of linearization in speech production.

An initial stage of speech production is conceptual planning, where a speaker determines which information to convey first (the linearization problem). This fMRI study investigated the linearization process during the production of "before" and "after" sentences. In "after" sentences, a series of events is expressed in the order of event occurrence.

Others' actions reduce crossmodal integration in peripersonal space.

Specific mechanisms integrate visual-tactile information close to the body to guide voluntary action [1, 2] and to enable rapid self-defense in peripersonal space [3-5]. In social interactions, others frequently act in one's peripersonal space, thereby changing the relevance of near-body events for one's own actions. Such changes of stimulus relevance may thus affect visual-tactile integration.

The role of synchrony and ambiguity in speech-gesture integration during comprehension.

During face-to-face communication, one does not only hear speech but also see a speaker's communicative hand movements. It has been shown that such hand gestures play an important role in communication where the two modalities influence each other's interpretation. A gesture typically temporally overlaps with coexpressive speech, but the gesture is often initiated before (but not after) the coexpressive speech.

Neurophysiological correlates of linearization in language production.

Background: During speech production the planning of a description of several events requires, among other things, a verbal sequencing of these events. During this process, referred to as linearization during conceptualization, the speaker can choose between different types of temporal connectives such as 'Before' X did A, Y did B' or 'After' Y did B, X did A'. To capture the neural events of such linearization processes, event-related potentials (ERP) were measured in native speakers of German.

Visual scenes trigger immediate syntactic reanalysis: evidence from ERPs during situated spoken comprehension.

A central topic in sentence comprehension research is the kinds of information and mechanisms involved in resolving temporary ambiguity regarding the syntactic structure of a sentence. Gaze patterns in scenes during spoken sentence comprehension have provided strong evidence that visual scenes trigger rapid syntactic reanalysis. However, they have also been interpreted as reflecting nonlinguistic, visual processes.