Cholinergic projection neurons of the nucleus basalis and substantia innominata (NBM/SI) densely innervate the basolateral amygdala (BLA) and have been shown to contribute to the encoding of fundamental and life-threatening experiences. Given the vital importance of these circuits in the acquisition and retention of memories that are essential for survival in a changing environment, it is not surprising that the basic anatomical organization of the NBM/SI is well conserved across animal classes as diverse as teleost and mammal. What is not known is the extent to which the physiology and morphology of NBM/SI neurons have also been conserved.
View Article and Find Full Text PDFBackground: One in eight children experience early life stress (ELS), which increases risk for psychopathology. ELS, particularly neglect, has been associated with reduced responsivity to reward. However, little work has investigated the computational specifics of this disrupted reward response - particularly with respect to the neural response to Reward Prediction Errors (RPE) - a critical signal for successful instrumental learning - and the extent to which they are augmented to novel stimuli.
View Article and Find Full Text PDFIn probabilistic reversal learning, the choice option yielding reward at higher probability switches at a random trial. To perform optimally in this task, one has to accumulate evidence across trials to infer the probability that a reversal has occurred. In this study, we investigated how this reversal probability is represented in cortical neurons by analyzing the neural activity in prefrontal cortex of monkeys and recurrent neural networks trained on the task.
View Article and Find Full Text PDFReinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens.
View Article and Find Full Text PDFIntrinsic uncertainty in the reward environment requires the brain to run multiple models simultaneously to predict outcomes based on preceding cues or actions, commonly referred to as stimulus- and action-based learning. Ultimately, the brain also must adopt appropriate choice behavior using reliability of these models. Here, we combined multiple experimental and computational approaches to quantify concurrent learning in monkeys performing tasks with different levels of uncertainty about the model of the environment.
View Article and Find Full Text PDFCholinergic projection neurons of the nucleus basalis and substantia innominata (NBM/SI) densely innervate the basolateral amygdala (BLA) and have been shown to contribute to the encoding of fundamental and life-threatening experiences. Given the vital importance of these circuits in the acquisition and retention of memories that are essential for survival in a changing environment, it is not surprising that the basic anatomical organization of the NBM/SI is well conserved across animal classes as diverse as teleost and mammal. What is not known is the extent to which the physiology and morphology of NBM/SI neurons have also been conserved.
View Article and Find Full Text PDFIn recent years, we and others have identified a number of enhancers that, when incorporated into rAAV vectors, can restrict the transgene expression to particular neuronal populations. Yet, viral tools to access and manipulate fine neuronal subtypes are still limited. Here, we performed systematic analysis of single cell genomic data to identify enhancer candidates for each of the cortical interneuron subtypes.
View Article and Find Full Text PDFOne third of people with psychosis become antipsychotic treatment-resistant and the underlying mechanisms remain unclear. We investigated whether altered cognitive control function is a factor underlying development of treatment resistance. We studied 50 people with early psychosis at a baseline visit (mean < 2 years illness duration) and follow-up visit (1 year later), when 35 were categorized at treatment-responsive and 15 as treatment-resistant.
View Article and Find Full Text PDFReinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g.
View Article and Find Full Text PDFReinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens.
View Article and Find Full Text PDFOpioid receptors within the CNS regulate pain sensation and mood and are key targets for drugs of abuse. Within the adult rodent hippocampus (HPC), μ-opioid receptor agonists suppress inhibitory parvalbumin-expressing interneurons (PV-INs), thus disinhibiting the circuit. However, it is uncertain if this disinhibitory motif is conserved in other cortical regions, species, or across development.
View Article and Find Full Text PDFDeciding whether to forego immediate rewards or explore new opportunities is a key component of flexible behavior and is critical for the survival of the species. Although previous studies have shown that different cortical and subcortical areas, including the amygdala and ventral striatum (VS), are implicated in representing the immediate (exploitative) and future (explorative) value of choices, the effect of the motor system used to make choices has not been examined. Here, we tested male rhesus macaques with amygdala or VS lesions on two versions of a three-arm bandit task where choices were registered with either a saccade or an arm movement.
View Article and Find Full Text PDFDecisions are made with different degrees of consistency, and this consistency can be linked to the confidence that the best choice has been made. Theoretical work suggests that attractor dynamics in networks can account for choice consistency, but how this is implemented in the brain remains unclear. Here, we provide evidence that the energy landscape around attractor basins in population neural activity in prefrontal cortex reflects choice consistency.
View Article and Find Full Text PDFReinforcement learning (RL) is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g.
View Article and Find Full Text PDFAdolescence is an important developmental period, during which substantial changes occur in brain function and behavior. Several aspects of executive function, including response inhibition, improve during this period. Correspondingly, structural imaging studies have documented consistent decreases in cortical and subcortical gray matter volume, and postmortem histologic studies have found substantial (∼40%) decreases in excitatory synapses in prefrontal cortex.
View Article and Find Full Text PDFDecisions are made with different degrees of consistency, and this consistency can be linked to the confidence that the best choice has been made. Theoretical work suggests that attractor dynamics in networks can account for choice consistency, but how this is implemented in the brain remains unclear. Here we provide evidence that the energy landscape around attractor basins in population neural activity in the prefrontal cortex reflects choice consistency.
View Article and Find Full Text PDFTranscranial direct current stimulation (tDCS) of the medial prefrontal cortex (mPFC) is under clinical investigation as a treatment for cognitive deficits. We investigate the effects of tDCS over the mPFC on performance SSLT in individuals with schizophrenia, and the underlying neurophysiological effect in regions associated with learning values and stimulus-outcome relationships. In this parallel-design double-blind pilot study, 49 individuals with schizophrenia, of whom 28 completed a fMRI, were randomized into active or sham tDCS stimulation groups.
View Article and Find Full Text PDFGenetically encoded synthetic receptors, such as the chemogenetic and optogenetic proteins, are powerful tools for functional brain studies in animals. In the primate brain, with its comparatively large, intricate anatomical structures, it can be challenging to express transgenes, such as the hM4Di chemogenetic receptor, in a defined anatomical structure with high penetrance. Here, we compare parameters for lentivirus vector injections in the rhesus monkey amygdala.
View Article and Find Full Text PDFThe ventral striatum (VS) and amygdala are two structures often implicated as essential structures for learning. The literature addressing the contribution of these areas to learning, however, is not entirely consistent. We propose that these inconsistencies are due to learning environments and the effect they have on motivation.
View Article and Find Full Text PDFThe auditory system transforms auditory stimuli from the external environment into perceptual auditory objects. Recent studies have focused on the contribution of the auditory cortex to this transformation. Other studies have yielded important insights into the contributions of neural activity in the auditory cortex to cognition and decision-making.
View Article and Find Full Text PDFPrevious research showed that uncertain, stochastic feedback drastically reduces children's performance. Here, 145 children from 7 to 11 years learned sets of sequences of four left-right button presses, each press followed by a red/green signal. After each of the 15% randomly false feedback trials, children received a verbal debrief that it was either (1) a mistake, or (2) a lie, or (3) received a reassuring comment for 85% correct trials.
View Article and Find Full Text PDFPLoS Comput Biol
January 2023
Choice impulsivity is characterized by the choice of immediate, smaller reward options over future, larger reward options, and is often thought to be associated with negative life outcomes. However, some environments make future rewards more uncertain, and in these environments impulsive choices can be beneficial. Here we examined the conditions under which impulsive vs.
View Article and Find Full Text PDFThe primate forebrain is a complex structure. Thousands of connections have been identified between cortical areas, and between cortical and sub-cortical areas. Previous work, however, has suggested that a number of principles can be used to reduce this complexity.
View Article and Find Full Text PDF