Beta Oscillations in Monkey Striatum Encode Reward Prediction Error Signals.

Reward prediction error (RPE) signals are crucial for reinforcement learning and decision-making as they quantify the mismatch between predicted and obtained rewards. RPE signals are encoded in the neural activity of multiple brain areas, such as midbrain dopaminergic neurons, prefrontal cortex, and striatum. However, it remains unclear how these signals are expressed through anatomically and functionally distinct subregions of the striatum.

Activity of fast-spiking interneurons in the monkey striatum during reaching movements guided by external cues or by a free choice.

Parvalbumin-containing GABAergic interneurons in the striatum, electrophysiologically identified as fast-spiking interneurons (FSIs), exert inhibitory control over striatal output to drive appropriate behavior. While a number of studies have emphasized their importance in motor control, it is unknown how these putative interneurons adapt their functional properties to different modes of movement selection. Here, we tested whether FSIs are sensitive to externally versus internally selected movements by recording their activity while two male rhesus monkeys performed reaching movements to visual targets.

Targeted Transgene Expression in Cholinergic Interneurons in the Monkey Striatum Using Canine Adenovirus Serotype 2 Vectors.

The striatum, the main input structure of the basal ganglia, is critical for action selection and adaptive motor control. To understand the neuronal mechanisms underlying these functions, an analysis of microcircuits that compose the striatum is necessary. Among these, cholinergic interneurons (ChIs) provide intrinsic striatal innervation whose dysfunction is implicated in neuropsychiatric diseases, such as Parkinson's disease and Tourette syndrome.

Temporal processing in the striatum: Interplay between midbrain dopamine neurons and striatal cholinergic interneurons.

There has been considerable progress in recent years toward understanding the neuronal mechanisms mediating time perception. Notably, the striatum and its dopamine (DA) input from the ventral midbrain are considered to be central for timing on the scale of hundreds of milliseconds and seconds. The cholinergic interneurons (ChIs) of the striatum provide an extensive local innervation, which closely interacts with striatal DA afferents.

Differences between Dorsal and Ventral Striatum in the Sensitivity of Tonically Active Neurons to Rewarding Events.

Within the striatum, cholinergic interneurons, electrophysiologically identified as tonically active neurons (TANs), represent a relatively homogeneous group in terms of their functional properties. They display typical pause in tonic firing in response to rewarding events which are of crucial importance for reinforcement learning. These responses are uniformly distributed throughout the dorsal striatum (i.

The role of the intrinsic cholinergic system of the striatum: What have we learned from TAN recordings in behaving animals?

Cholinergic interneurons provide rich local innervation of the striatum and play an important role in controlling behavior, as evidenced by the variety of movement and psychiatric disorders linked to disrupted striatal cholinergic transmission. Much progress has been made in recent years regarding our understanding of how these interneurons contribute to the processing of information in the striatum. In particular, investigation of the activity of presumed striatal cholinergic interneurons, identified as tonically active neurons or TANs in behaving animals, has pointed to their role in the signaling and learning of the motivational relevance of environmental stimuli.

Changes in activity of fast-spiking interneurons of the monkey striatum during reaching at a visual target.

Unlabelled: Recent works highlight the importance of local inhibitory interneurons in regulating the function of the striatum. In particular, fast-spiking interneurons (FSIs), which likely correspond to a subgroup of GABAergic interneurons, have been involved in the control of movement by exerting strong inhibition on striatal output pathways. However, little is known about the exact contribution of these presumed interneurons in movement preparation, initiation, and execution.

Modulation of neuronal activity by reward identity in the monkey subthalamic nucleus.

The subthalamic nucleus (STN) has been argued to be an important component of reward-sensitive basal ganglia circuitry. This view is especially supported by the behavioral changes observed after STN inactivation, which could reflect impairments in the motivational control of action. However, it is still unclear how the STN integrates reward information and to what extent such integration correlates with behavior.

Cortical and thalamic excitation mediate the multiphasic responses of striatal cholinergic interneurons to motivationally salient stimuli.

Cholinergic interneurons are key components of striatal microcircuits. In primates, tonically active neurons (putative cholinergic interneurons) exhibit multiphasic responses to motivationally salient stimuli that mirror those of midbrain dopamine neurons and together these two systems mediate reward-related learning in basal ganglia circuits. Here, we addressed the potential contribution of cortical and thalamic excitatory inputs to the characteristic multiphasic responses of cholinergic interneurons in vivo.

Linking reward processing to behavioral output: motor and motivational integration in the primate subthalamic nucleus.

The expectation and detection of motivationally relevant events is a major determinant of goal-directed behavior and there is a strong interest in the contribution of basal ganglia in the integration of motivational processes into behavioral output. Recent research has focused on the role of the subthalamic nucleus (STN) in the motivational control of action, but it remains to be determined how information about reward is encoded in this nucleus. We recorded the activity of single neurons in the STN of two behaving monkeys to examine whether activity was influenced by the delivery of reward in an instrumental task, a Pavlovian stimulus-reward association, or outside of a task context.

Importance of the temporal structure of movement sequences on the ability of monkeys to use serial order information.

The capacity to acquire motor skills through repeated practice of a sequence of movements underlies many everyday activities. Extensive research in humans has dealt with the importance of spatial and temporal factors on motor sequence learning, standing in contrast to the few studies available in animals, particularly in nonhuman primates. In the present experiments, we studied the effect of the serial order of stimuli and associated movements in macaque monkeys overtrained to make arm-reaching movements in response to spatially distinct visual targets.

The role of striatal tonically active neurons in reward prediction error signaling during instrumental task performance.

The detection of differences between predictions and actual outcomes is important for associative learning and for selecting actions according to their potential future reward. There are reports that tonically active neurons (TANs) in the primate striatum may carry information about errors in the prediction of rewards. However, this property seems to be expressed in classical conditioning tasks but not during performance of an instrumental task.

Modulation of neuronal activity in the monkey putamen associated with changes in the habitual order of sequential movements.

The striatum, especially its dorsolateral part, plays a major role in motor skill learning and habit formation, but it is still unclear how this contribution might be mediated at the neuronal level. We recorded single neurons in the posterior putamen of two monkeys performing an overlearned sequence of arm reaching movements to examine whether task-related activities are sensitive to manipulations of the serial order of stimulus-target locations. The monkeys' capacity to learn sequential regularities was assessed by comparing arm movement latencies and saccadic ocular reactions when a fixed repeating sequence was replaced with a random sequence.

Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context.

Tonically active neurons (TANs) in the primate striatum are responsive to rewarding stimuli and they are thought to be involved in the storage of stimulus-reward associations or habits. However, it is unclear whether these neurons may signal the difference between the prediction of reward and its actual outcome as a possible neuronal correlate of reward prediction errors at the striatal level. To address this question, we studied the activity of TANs from three monkeys trained in a classical conditioning task in which a liquid reward was preceded by a visual stimulus and reward probability was systematically varied between blocks of trials.

Leading tonically active neurons of the striatum from reward detection to context recognition.

Tonically active neurons (TANs) in the primate striatum, which are presumed to be cholinergic interneurons, carry signals that are traditionally considered to be important for reward-related learning. Recent studies investigating the functional properties of TANs in behaving monkeys have shown that other factors beyond motivation can affect their responsiveness. There is now evidence that TAN responses reflect stimulus detection, movement control and recognition of a specific context, suggesting that these local circuit neurons contribute to different computations used in learning and action functions of the striatum.

Influence of spatial information on responses of tonically active neurons in the monkey striatum.

Previous studies have demonstrated that tonically active neurons (TANs) in the primate striatum play an important role in the detection of rewarding events. However, the influence of the spatial features of stimuli or actions required to obtain reward remains unclear. Here, we examined the activity of TANs in the striatum of monkeys trained to make spatially directed movements elicited by visual stimuli presented ipsilaterally or contralaterally to the moving arm.

Reward-related neuronal activity in the subthalamic nucleus of the monkey.

The subthalamic nucleus is a key structure for motor information processing in the basal ganglia. Little is known about its involvement in other aspects of behavior such as motivation. We investigated neuronal activity in the subthalamic nucleus while a monkey performed arm-reaching movements to obtain a liquid reward.

Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli.

The striatum is involved in the control of appetitively motivated behavior. We found previously that tonically active neurons (TANs) in the monkey striatum show discriminative responses to different stimuli that are appetitive or aversive. However, these differential responses may reflect the sensory qualities of the stimulus rather than its motivational value.

Tonically active neurons in the primate striatum and their role in the processing of information about motivationally relevant events.

Analysis of recordings of single neuronal activity in the striatum of monkeys engaged in behavioural tasks has shown that tonically active neurons (TANs) can be distinguished by their distinct spontaneous firing and functional properties. As TANs are assumed to be cholinergic interneurons, the study of their physiological characteristics allows us to gain an insight into the role of a particular type of local-circuit neuron in the processing of information at the striatal level. In monkeys performing various behavioural tasks, the change in the activity of TANs, unlike the diversity of task-related activations exhibited by the phasically active population of striatal neurons, involves a transient depression of the tonic firing related to environmental events of motivational significance.