Flexible combination of reward information across primates.

A fundamental but rarely contested assumption in economics and neuroeconomics is that decision-makers compute subjective values of risky options by multiplying functions of reward probability and magnitude. By contrast, an additive strategy for valuation allows flexible combination of reward information required in uncertain or changing environments. We hypothesized that the level of uncertainty in the reward environment should determine the strategy used for valuation and choice.

Motor thalamus supports striatum-driven reinforcement.

Reinforcement has long been thought to require striatal synaptic plasticity. Indeed, direct striatal manipulations such as self-stimulation of direct-pathway projection neurons (dMSNs) are sufficient to induce reinforcement within minutes. However, it's unclear what role, if any, is played by downstream circuitry.

Volatility Facilitates Value Updating in the Prefrontal Cortex.

Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed.

Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty.

Value-based decision making often involves integration of reward outcomes over time, but this becomes considerably more challenging if reward assignments on alternative options are probabilistic and non-stationary. Despite the existence of various models for optimally integrating reward under uncertainty, the underlying neural mechanisms are still unknown. Here we propose that reward-dependent metaplasticity (RDMP) can provide a plausible mechanism for both integration of reward under uncertainty and estimation of uncertainty itself.

A Direct Path to Action Initiation.

In this issue of Neuron, Sippy et al. (2015) provide the clearest evidence to date that information is differentially encoded in the direct and indirect pathways of the striatum. The results support the classical notion that the direct pathway plays a critical role in initiating actions.

Dynamic routing of task-relevant signals for decision making in dorsolateral prefrontal cortex.

Neurons in the dorsolateral prefrontal cortex (DLPFC) encode a diverse array of sensory and mnemonic signals, but little is known about how this information is dynamically routed during decision making. We analyzed the neuronal activity in the DLPFC of monkeys performing a probabilistic reversal task where information about the probability and magnitude of reward was provided by the target color and numerical cues, respectively. The location of the target of a given color was randomized across trials and therefore was not relevant for subsequent choices.

Neural correlates of strategic reasoning during competitive games.

Although human and animal behaviors are largely shaped by reinforcement and punishment, choices in social settings are also influenced by information about the knowledge and experience of other decision-makers. During competitive games, monkeys increased their payoffs by systematically deviating from a simple heuristic learning algorithm and thereby countering the predictable exploitation by their computer opponent. Neurons in the dorsomedial prefrontal cortex (dmPFC) signaled the animal's recent choice and reward history that reflected the computer's exploitative strategy.

Cortical signals for rewarded actions and strategic exploration.

In stable environments, decision makers can exploit their previously learned strategies for optimal outcomes, while exploration might lead to better options in unstable environments. Here, to investigate the cortical contributions to exploratory behavior, we analyzed single-neuron activity recorded from four different cortical areas of monkeys performing a matching-pennies task and a visual search task, which encouraged and discouraged exploration, respectively. We found that neurons in multiple regions in the frontal and parietal cortex tended to encode signals related to previously rewarded actions more reliably than unrewarded actions.

Somatosensory responses in normal aging, mild cognitive impairment, and Alzheimer's disease.

As a part of a larger study of normal aging and Alzheimer's disease (AD), which included patients with mild cognitive impairment (MCI), we investigated the response to median nerve stimulation in primary and secondary somatosensory areas. We hypothesized that the somatosensory response would be relatively spared given the reported late involvement of sensory areas in the progression of AD. We applied brief pulses of electric current to left and right median nerves to test the somatosensory response in normal elderly (NE), MCI, and AD.