Reinforcement learning models treat the basal ganglia (BG) as an actor-critic network. The ventral pallidum (VP) is a major component of the BG limbic system. However, its precise functional roles within the BG circuitry, particularly in comparison to the adjacent external segment of the globus pallidus (GPe), remain unexplored. We recorded the spiking activity of VP neurons, GPe cells (actor) and striatal cholinergic interneurons (critic) while monkeys performed a classical conditioning task. Here, we report that VP neurons can be classified into two distinct populations. The persistent population displayed sustained activation following visual cue presentation, was correlated with monkeys' behavior and showed uncorrelated spiking activity. The transient population displayed phasic synchronized responses that were correlated with the rate of learning and the reinforcement learning model's prediction error. Our results suggest that the VP is physiologically different from the GPe and identify the transient VP neurons as a BG critic.

Download full-text PDF

Source
http://dx.doi.org/10.1038/s41593-020-0605-yDOI Listing

Publication Analysis

Top Keywords

reinforcement learning
12
ventral pallidum
8
basal ganglia
8
spiking activity
8
population displayed
8
dissociable roles
4
roles ventral
4
neurons
4
pallidum neurons
4
neurons basal
4

Similar Publications

Background: Depression is being increasingly acknowledged as an important risk factor contributing to coronary heart disease (CHD). Currently, there is no predictive model specifically designed to evaluate the risk of coronary heart disease among individuals with depression. We aim to develop a machine learning (ML) model that will analyze risk factors and forecast the probability of coronary heart disease in individuals suffering from depression.

View Article and Find Full Text PDF

Reinforcement Learning is Impaired in the Sub-acute Post-stroke Period.

Neurorehabil Neural Repair

January 2025

Department of Physical Medicine and Rehabilitation, Johns Hopkins University, Baltimore, MD, USA.

Background: In humans, most spontaneous recovery from motor impairment after stroke occurs in the first 3 months. Studies in animal models show higher responsiveness to training over a similar time-period. Both phenomena are often attributed to a milieu of heightened plasticity, which may share some mechanistic overlap with plasticity associated with normal motor learning.

View Article and Find Full Text PDF

Rats and mice rapidly update timed behaviors.

Anim Cogn

January 2025

Neuroscience Department, Oberlin College, 173 Lorain St, Oberlin, OH, USA.

Keeping track of time intervals is a crucial aspect of behavior and cognition. Many theoretical models of how the brain times behavior make predictions for steady-state performance of well-learned intervals, but the rate of learning intervals in these models varies greatly, ranging from one-shot learning to learning over thousands of trials. Here, we explored how quickly rats and mice adapt to changes in interval durations using a serial fixed-interval task.

View Article and Find Full Text PDF

Expanding the brain's terrain for reward.

Science

January 2025

Department of Neuroscience, Karolinska Institutet, Stockholm, Sweden.

A previously unknown region in the brainstem controls dopamine activity.

View Article and Find Full Text PDF

Rewards are essential for motivation, decision-making, memory, and mental health. We identified the subventricular tegmental nucleus (SVTg) as a brainstem reward center. In mice, reward and its prediction activate the SVTg, and SVTg stimulation leads to place preference, reduced anxiety, and accumbal dopamine release.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!