Neural coding of choice and outcome are modulated by uncertainty in orbitofrontal but not secondary motor cortex.

Orbitofrontal cortex (OFC) and secondary motor cortex (M2) are both implicated in flexible reward learning but the conditions that differentially recruit these regions are not fully understood. We imaged calcium activity from single neurons in OFC or M2 during learning of uncertain reward probability schedules. After controlling for experience, predictions of choice were decoded from M2 neurons with similar accuracy under all certainty conditions, but were more accurately decoded from OFC neurons under greater uncertainty.

Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning.

Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of the ventral tegmental area dopamine (VTA) neurons. Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signaling. However, recent studies reveal more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits.

Sex differences in patch-leaving foraging decisions in rats.

The ubiquity, importance, and sophistication of foraging behavior makes it an ideal platform for studying naturalistic decision making in animals. We developed a spatial patch-foraging task for rats, in which subjects chose how long to remain in one foraging patch as the rate of food earnings steadily decreased. The cost of seeking out a new location was varied across sessions.

Theta oscillations in anterior cingulate cortex and orbitofrontal cortex differentially modulate accuracy and speed in flexible reward learning.

Flexible reward learning relies on frontal cortex, with substantial evidence indicating that anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC) subregions play important roles. Recent studies in both rat and macaque suggest theta oscillations (5-10 Hz) may be a spectral signature that coordinates this learning. However, network-level interactions between ACC and OFC in flexible learning remain unclear.

Sex differences in patch-leaving foraging decisions in rats.

The ubiquity, importance, and sophistication of foraging behavior makes it an ideal platform for studying naturalistic decision making in animals. We developed a spatial patch-foraging task for rats, in which subjects chose how long to remain in one foraging patch as the rate of food earnings steadily decreased. The cost of seeking out a new location was varied across sessions.

Making Sense of the Multiplicity and Dynamics of Navigational Codes in the Brain.

Since the discovery of conspicuously spatially tuned neurons in the hippocampal formation over 50 years ago, characterizing which, where, and how neurons encode navigationally relevant variables has been a major thrust of navigational neuroscience. While much of this effort has centered on the hippocampal formation and functionally-adjacent structures, recent work suggests that spatial codes, in some form or another, can be found throughout the brain, even in areas traditionally associated with sensation, movement, and executive function. In this review, we highlight these unexpected results, draw insights from comparison of these codes across contexts, regions, and species, and finally suggest an avenue for future work to make sense of these diverse and dynamic navigational codes.

Quitting while you're ahead: Patch foraging and temporal cognition.

Theoretical models of foraging are based on the maximization of food intake rate. Remarkably, foragers often hew close to the predictions of rate maximization, except for a frequently observed bias to remain in patches for too long. By sticking with depleting options beyond the optimal patch residence time-a phenomenon referred to as overharvesting or overstaying-foragers miss out on food they could have earned had they sought a new option elsewhere.

Spatial Representations in Rat Orbitofrontal Cortex.

The orbitofrontal cortex (OFC) and hippocampus share striking cognitive and functional similarities. As a result, both structures have been proposed to encode "cognitive maps" that provide useful scaffolds for planning complex behaviors. However, while this function has been exemplified by spatial coding in neurons of hippocampal regions-particularly place and grid cells-spatial representations in the OFC have been investigated far less.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories.

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict.

Prior Cocaine Use Alters the Normal Evolution of Information Coding in Striatal Ensembles during Value-Guided Decision-Making.

Substance use disorders (SUDs) are characterized by maladaptive behavior. The ability to properly adjust behavior according to changes in environmental contingencies necessitates the interlacing of existing memories with updated information. This can be achieved by assigning learning in different contexts to compartmentalized "states.

Processing in Lateral Orbitofrontal Cortex Is Required to Estimate Subjective Preference during Initial, but Not Established, Economic Choice.

The orbitofrontal cortex (OFC) is proposed to be critical to economic decision making. Yet one can inactivate OFC without affecting well-practiced choices. One possible explanation of this lack of effect is that well-practiced decisions are codified into habits or configural-based policies not normally thought to require OFC.

Can the VTA Come Out to Play? Only When the mPFC's Predictions Go Astray!

Confidence in perceptual decisions scales neural responses to violations in reward expectation. In this issue of Neuron, Lak et al. (2020) show that the medial prefrontal cortex in mice computes a confidence-dependent expectation signal that influences how dopamine neurons convey reward prediction errors to guide learning.

Complementary Task Structure Representations in Hippocampus and Orbitofrontal Cortex during an Odor Sequence Task.

Both hippocampus (HPC) and orbitofrontal cortex (OFC) have been shown to be critical for behavioral tasks that require use of an internal model or cognitive map, composed of the states and the relationships between them, which define the current environment or task at hand. One general idea is that the HPC provides the cognitive map, which is then transformed by OFC to emphasize information of relevance to current goals. Our previous analysis of ensemble activity in OFC in rats performing an odor sequence task revealed a rich representation of behaviorally relevant task structure, consistent with this proposal.

Rat Orbitofrontal Ensemble Activity Contains Multiplexed but Dissociable Representations of Value and Task Structure in an Odor Sequence Task.

The orbitofrontal cortex (OFC) has long been implicated in signaling information about expected outcomes to facilitate adaptive or flexible behavior. Current proposals focus on signaling of expected value versus the representation of a value-agnostic cognitive map of the task. While often suggested as mutually exclusive, these alternatives may represent extreme ends of a continuum determined by task complexity and experience.

Suppression of Ventral Hippocampal Output Impairs Integrated Orbitofrontal Encoding of Task Structure.

The hippocampus and orbitofrontal cortex (OFC) both make important contributions to decision making and other cognitive processes. However, despite anatomical links between the two, few studies have tested the importance of hippocampal-OFC interactions. Here, we recorded OFC neurons in rats performing a decision making task while suppressing activity in a key hippocampal output region, the ventral subiculum.

Rat mPFC and M2 Play a Waiting Game (at Different Timescales).

In this issue of Neuron, Murakami et al. (2017) relate neural activity in frontal cortex to stochastic and deterministic components of waiting behavior in rats; they find that mPFC biases waiting time, while M2 is ultimately responsible for trial-to-trial variability in decisions about how long to wait.

Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex.

The hippocampus and the orbitofrontal cortex (OFC) both have important roles in cognitive processes such as learning, memory and decision making. Nevertheless, research on the OFC and hippocampus has proceeded largely independently, and little consideration has been given to the importance of interactions between these structures. Here, evidence is reviewed that the hippocampus and OFC encode parallel, but interactive, cognitive 'maps' that capture complex relationships between cues, actions, outcomes and other features of the environment.

Toward a theoretical role for tonic norepinephrine in the orbitofrontal cortex in facilitating flexible learning.

To adaptively respond in a complex, changing world, animals need to flexibly update their understanding of the world when their expectations are violated. Though several brain regions in rodents and primates have been implicated in aspects of this updating, current models of orbitofrontal cortex (OFC) and norepinephrine neurons of the locus coeruleus (LC-NE) suggest that each plays a role in responding to environmental change, where the OFC allows updating of prior learning to occur without overwriting or unlearning one's previous understanding of the world that changed, while elevated tonic NE allows for increased flexibility in behavior that tracks an animal's uncertainty. In light of recent studies highlighting a specific LC-NE projection to the OFC, in this review we discuss current models of OFC and NE function, and their potential synergy in the updating of associations following environmental change.

The State of the Orbitofrontal Cortex.

State representation is fundamental to behavior. However, identifying the true state of the world is challenging when explicit cues are ambiguous. Here, Bradfield and colleagues show that the medial OFC is critical for using associative information to discriminate ambiguous states.

Hippocampal theta sequences reflect current goals.

Hippocampal information processing is discretized by oscillations, and the ensemble activity of place cells is organized into temporal sequences bounded by theta cycles. Theta sequences represent time-compressed trajectories through space. Their forward-directed nature makes them an intuitive candidate mechanism for planning future trajectories, but their connection to goal-directed behavior remains unclear.

Decoding the cognitive map: ensemble hippocampal sequences and decision making.

Tolman proposed that complex animal behavior is mediated by the cognitive map, an integrative learning system that allows animals to reconfigure previous experience in order to compute predictions about the future. The discovery of place cells in the rodent hippocampus immediately suggested a plausible neural mechanism to fulfill the 'map' component of Tolman's theory. Recent work examining hippocampal representations occurring at fast time scales suggests that these sequences might be important for supporting the inferential mental operations associated with the cognitive map function.

Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task.

Laboratory studies of decision making often take the form of two-alternative, forced-choice paradigms. In natural settings, however, many decision problems arise as stay/go choices. We designed a foraging task to test intertemporal decision making in rats via stay/go decisions.

The balance of forward and backward hippocampal sequences shifts across behavioral states.

Place cell firing patterns in the rat hippocampus are often organized as sequences. Sequences falling within cycles of the theta (6-10 Hz) local field potential (LFP) oscillation represent segments of ongoing behavioral trajectories. Sequences expressed during sharp wave ripple (SWR) complexes represent spatial trajectories through the environment, in both the same direction as actual trajectories (forward sequences) and in an ordering opposite that of behavior (backward sequences).

Hippocampal sequences link past, present, and future.

Disrupting the reactivation of hippocampal neurons during sleep impairs memory consolidation in rats. However, the functional importance of reactivation during awake states is unknown. An experiment in which awake reactivation was disrupted suggests that this phenomenon could adaptively guide behavior by linking previous learning with the current state of the world.