Resource-rational psychopathology.

Psychopathology is vast and diverse. Across distinct disease states, individuals exhibit symptoms that appear counter to the standard view of rationality (expected utility maximization). We argue that some aspects of psychopathology can be described as resource-rational, reflecting a rational trade-off between reward and cognitive resources.

Mild Vitamin C Deficiency Is Common in the Inpatient Psychiatric Setting.

Mild vitamin C deficiency is a psychiatrically relevant nutritional state, with symptoms including apathy, fatigue, and low mood. Although complete vitamin C deficiency has largely been eradicated, mild deficiency remains common in certain populations. Here, we aimed to identify the prevalence of mild vitamin C deficiency in the inpatient psychiatric setting.

A Bayesian Reanalysis of a Trial of Psilocybin versus Escitalopram for Depression.

Objectives: To perform a Bayesian reanalysis of a recent trial of psilocybin (COMP360) versus escitalopram for Major Depressive Disorder (MDD) in order to provide a more informative interpretation of the indeterminate outcome of a previous frequentist analysis.

Design: Reanalysis of a two-arm double-blind placebo controlled trial.

Participants: Fifty-nine patients with MDD.

Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys.

Despite being unpredictable and uncertain, reward environments often exhibit certain regularities, and animals navigating these environments try to detect and utilize such regularities to adapt their behavior. However, successful learning requires that animals also adjust to uncertainty associated with those regularities. Here, we analyzed choice data from two comparable dynamic foraging tasks in mice and monkeys to investigate mechanisms underlying adjustments to different types of uncertainty.

Undermatching Is a Consequence of Policy Compression.

The matching law describes the tendency of agents to match the ratio of choices allocated to the ratio of rewards received when choosing among multiple options (Herrnstein, 1961). Perfect matching, however, is infrequently observed. Instead, agents tend to undermatch or bias choices toward the poorer option.

Serotonin neurons modulate learning rate through uncertainty.

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes.

Entropy-based metrics for predicting choice behavior based on local response to reward.

For decades, behavioral scientists have used the matching law to quantify how animals distribute their choices between multiple options in response to reinforcement they receive. More recently, many reinforcement learning (RL) models have been developed to explain choice by integrating reward feedback over time. Despite reasonable success of RL models in capturing choice on a trial-by-trial basis, these models cannot capture variability in matching behavior.

Aversive stimuli bias corticothalamic responses to motivationally significant cues.

Making predictions about future rewards or punishments is fundamental to adaptive behavior. These processes are influenced by prior experience. For example, prior exposure to aversive stimuli or stressors changes behavioral responses to negative- and positive-value predictive cues.

Reinforcement learning modeling reveals a reward-history-dependent strategy underlying reversal learning in squirrel monkeys.

Insight into psychiatric disease and development of therapeutics relies on behavioral tasks that study similar cognitive constructs in multiple species. The reversal learning task is one popular paradigm that probes flexible behavior, aberrations of which are thought to be important in a number of disease states. Despite widespread use, there is a need for a high-throughput primate model that can bridge the genetic, anatomic, and behavioral gap between rodents and humans.

Subthreshold basis for reward-predictive persistent activity in mouse prefrontal cortex.

Nervous systems maintain information internally using persistent activity changes. The mechanisms by which this activity arises are incompletely understood. We study prefrontal cortex (PFC) in mice performing behaviors in which stimuli predicted rewards at different delays with different probabilities.

Dynamic decision making and value computations in medial frontal cortex.

Dynamic decision making requires an intact medial frontal cortex. Recent work has combined theory and single-neuron measurements in frontal cortex to advance models of decision making. We review behavioral tasks that have been used to study dynamic decision making and algorithmic models of these tasks using reinforcement learning theory.

Locus coeruleus spiking differently correlates with S1 cortex activity and pupil diameter in a tactile detection task.

We examined the relationships between activity in the locus coeruleus (LC), activity in the primary somatosensory cortex (S1), and pupil diameter in mice performing a tactile detection task. While LC spiking consistently preceded S1 membrane potential depolarization and pupil dilation, the correlation between S1 and pupil was more heterogeneous. Furthermore, the relationships between LC, S1, and pupil varied on timescales of sub-seconds to seconds within trials.

A quantitative reward prediction error signal in the ventral pallidum.

The nervous system is hypothesized to compute reward prediction errors (RPEs) to promote adaptive behavior. Correlates of RPEs have been observed in the midbrain dopamine system, but the extent to which RPE signals exist in other reward-processing regions is less well understood. In the present study, we quantified outcome history-based RPE signals in the ventral pallidum (VP), a basal ganglia region functionally linked to reward-seeking behavior.

Locus coeruleus-norepinephrine: basic functions and insights into Parkinson's disease.

The locus coeruleus is a pontine nucleus that produces much of the brain's norepinephrine. Despite its small size, the locus coeruleus is critical for a myriad of functions and is involved in many neurodegenerative and neuropsychiatric disorders. In this review, we discuss the physiology and anatomy of the locus coeruleus system and focus on norepinephrine's role in synaptic plasticity.

Stable Representations of Decision Variables for Flexible Behavior.

Decisions occur in dynamic environments. In the framework of reinforcement learning, the probability of performing an action is influenced by decision variables. Discrepancies between predicted and obtained rewards (reward prediction errors) update these variables, but they are otherwise stable between decisions.

Behavioral and electrophysiological effects of cortical microstimulation parameters.

Electrical microstimulation has been widely used to artificially activate neural circuits on fast time scales. Despite the ubiquity of its use, little is known about precisely how it activates neural pathways. Current is typically delivered to neural tissue in a manner that provides a locally balanced injection of positive and negative charge, resulting in negligible net charge delivery to avoid the neurotoxic effects of charge accumulation.

Detection of tactile inputs in the rat vibrissa pathway.

The rapid detection of sensory inputs is crucial for survival. Sensory detection explicitly requires the integration of incoming sensory information and the ability to distinguish between relevant information and ongoing neural activity. In this study, head-fixed rats were trained to detect the presence of a brief deflection of their whiskers resulting from a focused puff of air.