Orbitofrontal cortex and learning predictions of state transitions.

The orbitofrontal cortex (OFC) has been implicated in goal-directed planning and model-based decision-making. One key prerequisite for model-based decision-making is learning the transition structure of the environment-the probabilities of transitioning from one environmental state to another. In this work, we investigated how the OFC might be involved in learning this transition structure, by using fMRI to assess OFC activity while humans experienced probabilistic cue-outcome transitions.

Orbitofrontal neurons signal sensory associations underlying model-based inference in a sensory preconditioning task.

Using knowledge of the structure of the world to infer value is at the heart of model-based reasoning and relies on a circuit that includes the orbitofrontal cortex (OFC). Some accounts link this to the representation of biological significance or value by neurons in OFC, while other models focus on the representation of associative structure or cognitive maps. Here we tested between these accounts by recording OFC neurons in rats during an OFC-dependent sensory preconditioning task.

Ensembles in medial and lateral orbitofrontal cortex construct cognitive maps emphasizing different features of the behavioral landscape.

The orbitofrontal cortex (OFC) has long been implicated in the ability to use the current value of expected outcomes to guide behavior. More recently, this specific role has been conceptualized as a special case of a more general function that OFC plays in constructing a "cognitive map" of the behavioral task space by labeling the current task state and learning relationships among task states. Here, we have used single unit recording data from 2 prior studies to examine whether and how information relating different states within and across trials is represented in medial versus lateral OFC in rats.

Medial Orbitofrontal Neurons Preferentially Signal Cues Predicting Changes in Reward during Unblocking.

Unlabelled: The orbitofrontal cortex (OFC) has been broadly implicated in the ability to use the current value of expected outcomes to guide behavior. Although value correlates have been prominently reported in lateral OFC, they are more often associated with more medial areas. Further, recent studies in primates have suggested a dissociation in which the lateral OFC is involved in credit assignment and representation of reward identity and more medial areas are critical to representing value.

Lateral orbitofrontal neurons acquire responses to upshifted, downshifted, or blocked cues during unblocking.

The lateral orbitofrontal cortex (lOFC) has been described as signaling either outcome expectancies or value. Previously, we used unblocking to show that lOFC neurons respond to a predictive cue signaling a 'valueless' change in outcome features (McDannald, 2014). However, many lOFC neurons also fired to a cue that simply signaled more reward.

Model-based learning and the contribution of the orbitofrontal cortex to the model-free world.

Learning is proposed to occur when there is a discrepancy between reward prediction and reward receipt. At least two separate systems are thought to exist: one in which predictions are proposed to be based on model-free or cached values; and another in which predictions are model-based. A basic neural circuit for model-free reinforcement learning has already been described.