Over the past 20 years, neuroscience research on reward-based learning has converged on a canonical model, under which the neurotransmitter dopamine 'stamps in' associations between situations, actions and rewards by modulating the strength of synaptic connections between neurons. However, a growing number of recent findings have placed this standard model under strain. We now draw on recent advances in artificial intelligence to introduce a new theory of reward-based learning. Here, the dopamine system trains another part of the brain, the prefrontal cortex, to operate as its own free-standing learning system. This new perspective accommodates the findings that motivated the standard model, but also deals gracefully with a wider range of observations, providing a fresh foundation for future research.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1038/s41593-018-0147-8 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
The medial prefrontal cortex (mPFC) is required for learning associations that determine whether animals approach or avoid potential threats in the environment. Dopaminergic (DA) projections from the ventral tegmental area (VTA) to the mPFC carry information, particularly about aversive outcomes, that may inform prefrontal computations. But the role of prefrontal DA in learning based on aversive outcomes remains poorly understood.
View Article and Find Full Text PDFAnimals capable of complex behaviors tend to have more distinct brain areas than simpler organisms, and artificial networks that perform many tasks tend to self-organize into modules (1-3). This suggests that different brain areas serve distinct functions supporting complex behavior. However, a common observation is that essentially anything that an animal senses, knows, or does can be decoded from neural activity in any brain area (4-6).
View Article and Find Full Text PDFDebilitating anxiety is pervasive in the modern world. Choices to approach or avoid are common in everyday life and excessive avoidance is a cardinal feature of all anxiety disorders. Here, we used intracranial EEG to define a distributed prefrontal-limbic circuit dynamics supporting approach and avoidance.
View Article and Find Full Text PDFMajor depressive disorder (MDD) is a common mood condition affecting multiple brain regions and cell types. Changes in astrocyte function contribute to depressive-like behaviors. However, while neuronal mechanisms driving MDD have been studied in some detail, molecular mechanisms by which astrocytes promote depression have not been extensively explored.
View Article and Find Full Text PDFActivating the Astrocytes of the Dorsal Raphe Nucleus via Its Neural Circuits With the Medial Prefrontal Cortex Improves Depression in Mice.
Behav Neurol
January 2025
Laboratory of Neurobiology, School of Basic Medical Sciences, Tianjin Medical University, Tianjin, China.
Astrocytes are the primary cell type in the central nervous system, responsible for maintaining the stability of the brain's internal environment and supporting neuronal functions. Researches have demonstrated the close relationship between astrocytes and the pathophysiology and etiology of major depressive disorder. However, the regulatory mechanisms of astrocytes during depression remain unclear.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!