Vienna Talking Faces (ViTaFa): A multimodal person database with synchronized videos, images, and voices.

Social perception relies on different sensory channels, including vision and audition, which are specifically important for judgements of appearance. Therefore, to understand multimodal integration in person perception, it is important to study both face and voice in a synchronized form. We introduce the Vienna Talking Faces (ViTaFa) database, a high-quality audiovisual database focused on multimodal research of social perception.

Alteration of the temporal association between courtship audio and visual components affects female sexual response.

Some multimodal signals-that is, occurring in more than one sensory modality-appear to carry additional information which is not present when component signals are presented separately. To understand the function of male ring dove's (Streptopelia risoria) multimodal courtship, we used audiovisual playback of male displays to investigate female response to stimuli differing in their audiovisual timing. From natural courtship recordings, we created a shifted stimulus where audio was shifted relative to video by a fixed value and a jittered stimulus, where each call was moved randomly along the visual channel.

Art and Perception: Using Empirical Aesthetics in Research on Consciousness.

Understanding consciousness is a major frontier in the natural sciences. However, given the nuanced and ambiguous sets of conditions regarding how and when consciousness appears to manifest, it is also one of the most elusive topics for investigation. In this context, we argue that research in empirical aesthetics-specifically on the experience of art-holds strong potential for this research area.

Forgotten rhythms? Revisiting the first evidence for rhythms in cognition.

Practically every neuroscientist knows that human brain rhythms were first recorded in the 1920s by Hans Berger, who coined the term 'alpha waves' for the regular activity of around 10 cycles per second that was clearly visible in many of his recordings. Almost 100 years later, alpha rhythms are still the subject of active investigation and continue to intrigue researchers. What we have perhaps forgotten though, is the clever experimentation that was carried out during the first decades of electroencephalogram (EEG) research, often using sophisticated, custom-made analysis and stimulation devices.

Video Recording and Analysis of Avian Movements and Behavior: Insights from Courtship Case Studies.

Video recordings are useful tools for advancing our understanding of animal movements and behavior. Over the past decades, a burgeoning area of behavioral research has put forward innovative methods to investigate animal movement using video analysis, which includes motion capture and machine learning algorithms. These tools are particularly valuable for the study of elaborate and complex motor behaviors, but can be challenging to use.

Cholinergic manipulations affect sensory responses but not attentional enhancement in macaque MT.

Background: Attentional modulation in the visual cortex of primates is characterized by multiplicative changes of sensory responses with changes in the attentional state of the animal. The cholinergic system has been linked to such gain changes in V1. Here, we aim to determine if a similar link exists in macaque area MT.

Song Is More Memorable Than Speech Prosody: Discrete Pitches Aid Auditory Working Memory.

Vocal music and spoken language both have important roles in human communication, but it is unclear why these two different modes of vocal communication exist. Although similar, speech and song differ in certain design features. One interesting difference is in the pitch intonation contour, which consists of discrete tones in song, vs.

Evolution and function of multimodal courtship displays.

Courtship displays are behaviours aimed to facilitate attraction and mating with the opposite sex and are very common across the animal kingdom. Most courtship displays are multimodal, meaning that they are composed of concomitant signals occurring in different sensory modalities. Although courtship often strongly influences reproductive success, the question of why and how males use multimodal courtship to increase their fitness has not yet received much attention.

A Pressure Injection System for Investigating the Neuropharmacology of Information Processing in Awake Behaving Macaque Monkey Cortex.

The top-down modulation of feed-forward cortical information processing is functionally important for many cognitive processes, including the modulation of sensory information processing by attention. However, little is known about which neurotransmitter systems are involved in such modulations. A practical way to address this question is to combine single-cell recording with local and temporary neuropharmacological manipulation in a suitable animal model.

Feature-selective attention in healthy old age: a selective decline in selective attention?

Deficient selection against irrelevant information has been proposed to underlie age-related cognitive decline. We recently reported evidence for maintained early sensory selection when older and younger adults used spatial selective attention to perform a challenging task. Here we explored age-related differences when spatial selection is not possible and feature-selective attention must be deployed.

Competitive interactions of attentional resources in early visual cortex during sustained visuospatial attention within or between visual hemifields: evidence for the different-hemifield advantage.

Performing a task across the left and right visual hemifields results in better performance than in a within-hemifield version of the task, termed the different-hemifield advantage. Although recent studies used transient stimuli that were presented with long ISIs, here we used a continuous objective electrophysiological (EEG) measure of competitive interactions for attentional processing resources in early visual cortex, the steady-state visual evoked potential (SSVEP). We frequency-tagged locations in each visual quadrant and at central fixation by flickering light-emitting diodes (LEDs) at different frequencies to elicit distinguishable SSVEPs.

Keeping focused: sustained spatial selective visual attention is maintained in healthy old age.

A better understanding of age-related change in the attentional modulation of perceptual processing may help elucidate cognitive change. For example, increased cognitive interference due to inappropriate processing of irrelevant information has been suggested to contribute to cognitive decline. However, it is not yet clear whether interference effects observed at later stages, such as executive function or response selection, are caused by leaky attentional selection at early, sensory stages of processing.

Effects of overt and covert attention on the steady-state visual evoked potential.

Flickering stimuli evoke an oscillatory brain response with the same frequency as the driving stimulus, the so-called steady-state visual evoked potential (SSVEP). SSVEPs are robust brain signals whose amplitudes are enhanced with attention and thus play a major role in the development and use of non-invasive Brain-Computer Interfaces (BCIs). We compared the modulation of SSVEP amplitudes when subjects directly gazed at a flickering array of static dots (overt attention) to when they covertly shifted attention to the dots keeping their eyes at central fixation.

Independent effects of attentional gain control and competitive interactions on visual stimulus processing.

Attention filters behaviorally relevant stimuli from the constant stream of sensory information comprising our environment. Research into underlying neural mechanisms in humans suggests that visual attention biases mutual suppression between stimuli resulting from competition for limited processing resources. As a consequence, processing of an attended stimulus is facilitated.

Feature-selective attention: evidence for a decline in old age.

Although attention in older adults is an active research area, feature-selective aspects have not yet been explicitly studied. Here we report the results of an exploratory study involving directed changes in feature-selective attention. The stimuli used were two random dot kinematograms (RDKs) of different colours, superimposed and centrally presented.

Visual stimulus locking of EEG is modulated by temporal congruency of auditory stimuli.

Disparate sensory streams originating from a common underlying event share similar dynamics, and this plays an important part in multisensory integration. Here we investigate audiovisual binding by presenting continuously changing, temporally congruent and incongruent stimuli. Recorded EEG signals are used to quantify spectrotemporal and waveform locking of neural activity to stimulus dynamics.