Using Natural Scenes to Enhance our Understanding of the Cerebral Cortex's Role in Visual Search.

Using natural scenes is an approach to studying the visual and eye movement systems approximating how these systems function in everyday life. This review examines the results from behavioral and neurophysiological studies using natural scene viewing in humans and monkeys. The use of natural scenes for the study of cerebral cortical activity is relatively new and presents challenges for data analysis.

From Prior Information to Saccade Selection: Evolution of Frontal Eye Field Activity during Natural Scene Search.

Prior knowledge about our environment influences our actions. How does this knowledge evolve into a final action plan and how does the brain represent this? Here, we investigated this question in the monkey oculomotor system during self-guided search of natural scenes. In the frontal eye field (FEF), we found a subset of neurons, "Early neurons," that contain information about the upcoming saccade long before it is executed, often before the previous saccade had even ended.

Predicting rhesus monkey eye movements during natural-image search.

There are three prominent factors that can predict human visual-search behavior in natural scenes: the distinctiveness of a location (salience), similarity to the target (relevance), and features of the environment that predict where the object might be (context). We do not currently know how well these factors are able to predict macaque visual search, which matters because it is arguably the most popular model for asking how the brain controls eye movements. Here we trained monkeys to perform the pedestrian search task previously used for human subjects.

Feature-based attention and spatial selection in frontal eye fields during natural scene search.

When we search for visual objects, the features of those objects bias our attention across the visual landscape (feature-based attention). The brain uses these top-down cues to select eye movement targets (spatial selection). The frontal eye field (FEF) is a prefrontal brain region implicated in selecting eye movements and is thought to reflect feature-based attention and spatial selection.

Role of expected reward in frontal eye field during natural scene search.

When a saccade is expected to result in a reward, both neural activity in oculomotor areas and the saccade itself (e.g., its vigor and latency) are altered (compared with when no reward is expected).

Visual Experience Is Required for the Development of Eye Movement Maps in the Mouse Superior Colliculus.

Unlabelled: Topographic maps are a fundamental feature of the brain's representations of the sensory environment as well as an efficient way to organize motor control networks. Although great progress has been made in our understanding of sensory map development, very little is known about how topographic representations for motor control develop and interface with sensory maps. Here we map the representation for eye movements in the superior colliculus (SC) in awake mice.

Saliency and saccade encoding in the frontal eye field during natural scene search.

The frontal eye field (FEF) plays a central role in saccade selection and execution. Using artificial stimuli, many studies have shown that the activity of neurons in the FEF is affected by both visually salient stimuli in a neuron's receptive field and upcoming saccades in a certain direction. However, the extent to which visual and motor information is represented in the FEF in the context of the cluttered natural scenes we encounter during everyday life has not been explored.

Inhibition in superior colliculus neurons in a brightness discrimination task?

Simultaneous recordings were collected from between two and four buildup neurons from the left and right superior colliculi in rhesus monkeys in a simple two-choice brightness discrimination task. The monkeys were required to move their eyes to one of two response targets to indicate their decision. Neurons were identified whose receptive fields were centered on the response targets.

Predictive activity in macaque frontal eye field neurons during natural scene searching.

Generating sequences of multiple saccadic eye movements allows us to search our environment quickly and efficiently. Although the frontal eye field cortex (FEF) has been linked to target selection and making saccades, little is known about its role in the control and performance of the sequences of saccades made during self-guided visual search. We recorded from FEF cells while monkeys searched for a target embedded in natural scenes and examined the degree to which cells with visual and visuo-movement activity showed evidence of target selection for future saccades.

Neural mind reading of multi-dimensional decisions by monkey mid-brain activity.

Brain-machine interfaces (BMIs) have the potential to improve the quality of life for individuals with disabilities. We engaged in the development of neural mind-reading techniques for cognitive BMIs to provide a readout of decision processes. We trained 2 monkeys on go/no-go tasks, and monitored the activity of groups of neurons in their mid-brain superior colliculus (SC).

Dual diffusion model for single-cell recording data from the superior colliculus in a brightness-discrimination task.

Monkeys made saccades to one of two peripheral targets based on the brightness of a central stimulus. Task difficulty was manipulated by varying the ratio of stimulus black-and-white pixels. Correct response probability for two monkeys varied directly with difficulty.

Single trial-based prediction of a go/no-go decision in monkey superior colliculus.

While some decision-making processes often result in the generation of an observable action, for example eye or limb movements, others may prevent actions and occur without an overt behavioral response. To understand how these decisions are made, one must look directly at their neuronal substrates. We trained two monkeys on a go/no-go task which requires a saccade to a peripheral cue stimulus (go) or maintenance of fixation (no-go).

Effects of eye position upon activity of neurons in macaque superior colliculus.

We examined the activity of neurons in the deep layers of the superior colliculus of awake behaving rhesus monkeys during the performance of standard oculomotor tasks as well as during self-guided eye movements made while viewing natural images. The standard tasks were used to characterize the activity of neurons based on established criteria. The natural viewing paradigm enabled the sampling of neuronal activity during saccades and fixations distributed over a wide range of eye positions.

Macaque frontal eye field input to saccade-related neurons in the superior colliculus.

Extracellular recordings were made simultaneously in the frontal eye field and superior colliculus in awake, behaving rhesus monkeys. Frontal eye field microstimulation was used to orthodromically activate the superior colliculus both to locate the depth of the strongest frontal eye field input to the superior colliculus and to identify superior colliculus neurons receiving direct frontal eye field input. The activity of orthodromically driven colliculus neurons was characterized during visuomotor tasks.