Author Correction: Dissociating task acquisition from expression during learning reveals latent knowledge.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Dissociating task acquisition from expression during learning reveals latent knowledge.

Performance on cognitive tasks during learning is used to measure knowledge, yet it remains controversial since such testing is susceptible to contextual factors. To what extent does performance during learning depend on the testing context, rather than underlying knowledge? We trained mice, rats and ferrets on a range of tasks to examine how testing context impacts the acquisition of knowledge versus its expression. We interleaved reinforced trials with probe trials in which we omitted reinforcement.

Occasion setting.

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs.

Stimulus preexposure speeds or slows subsequent acquisition of associative learning depending on learning test procedures and response measure.

Prior exposure to a conditioned stimulus (CS) typically results in latent inhibition-slower acquisition of associative learning about that stimulus in subsequent training. Here, we found that CS preexposure had different effects on the appetitive conditioning of rats with a sucrose unconditioned stimulus (US) depending on training test procedures, the similarity of preexposure and training procedures, and the choice of response measure. Preexposure to a visual or an auditory stimulus produced facilitation of acquisition of food-cup-directed responding when both of those cues were (separately) paired with sucrose delivery in the training test (Experiments 1 and 3).

Consolidation of altered associability information by amygdala central nucleus.

The surprising omission of a reinforcer can enhance the associability of the stimuli that were present when the reward prediction error was induced, so that they more readily enter into new associations in the future. Previous research from this laboratory identified brain circuit elements critical to the enhancement of stimulus associability by the omission of an expected event and to the subsequent expression of that altered associability in more rapid learning. These elements include the amygdala, the midbrain substantia nigra, the basal forebrain substantia innominata, the dorsolateral striatum, the secondary visual cortex, and the posterior parietal cortex.

Secondary visual cortex is critical to the expression of surprise-induced enhancements in cue associability in rats.

Considerable evidence indicates that reinforcement prediction error, the difference between the obtained and expected reinforcer values, modulates attention to potential cues for reinforcement. The surprising delivery or omission of a reinforcer enhances the associability of the stimuli that were present when the error was induced, so that they more readily enter into new associations in the future. Previous research from our laboratory identified brain circuit elements critical to the enhancement of stimulus associability by omission of an expected event and to the subsequent expression of that altered associability in more rapid learning.

Effects of amygdala lesions on overexpectation phenomena in food cup approach and autoshaping procedures.

Prediction error (PE) plays a critical role in most modern theories of associative learning, by determining the effectiveness of conditioned stimuli (CS) or unconditioned stimuli (US). Here, we examined the effects of lesions of central (CeA) or basolateral (BLA) amygdala on performance in overexpectation tasks. In 2 experiments, after 2 CSs were separately paired with the US, they were combined and followed by the same US.

Mini-review: Prediction errors, attention and associative learning.

Most modern theories of associative learning emphasize a critical role for prediction error (PE, the difference between received and expected events). One class of theories, exemplified by the Rescorla-Wagner (1972) model, asserts that PE determines the effectiveness of the reinforcer or unconditioned stimulus (US): surprising reinforcers are more effective than expected ones. A second class, represented by the Pearce-Hall (1980) model, argues that PE determines the associability of conditioned stimuli (CSs), the rate at which they may enter into new learning: the surprising delivery or omission of a reinforcer enhances subsequent processing of the CSs that were present when PE was induced.

The antagonism of ghrelin alters the appetitive response to learned cues associated with food.

The rapid increase in obesity may be partly mediated by an increase in the exposure to cues for food. Food-paired cues play a role in food procurement and intake under conditions of satiety. The mechanism by which this occurs requires characterization, but may involve ghrelin.

Enhancing second-order conditioning with lesions of the basolateral amygdala.

Because the occurrence of primary reinforcers in natural environments is relatively rare, conditioned reinforcement plays an important role in many accounts of behavior, including pathological behaviors such as the abuse of alcohol or drugs. As a result of pairing with natural or drug reinforcers, initially neutral cues acquire the ability to serve as reinforcers for subsequent learning. Accepting a major role for conditioned reinforcement in everyday learning is complicated by the often-evanescent nature of this phenomenon in the laboratory, especially when primary reinforcers are entirely absent from the test situation.

Dorsolateral striatum is critical for the expression of surprise-induced enhancements in cue associability.

The dorsolateral striatum (DLS) is frequently implicated in sensory-motor integration, including the performance of sensory orienting responses (ORs) and learned stimulus-response habits. Our laboratory previously identified a role for the DLS in rats' performance of conditioned ORs to Pavlovian cues for food delivery. Here, we considered whether DLS is also critical to another aspect of attention in associative learning, the surprise-induced enhancement of cue associability.

Dorsolateral striatum implicated in the acquisition, but not expression, of immediate response learning in rodent submerged T-maze.

Animals can use multiple strategies when learning about, and navigating within, their environment. Typically, in the frequently-studied food-rewarded T-maze, rats initially adopt a flexible, hippocampal-dependent place strategy. However, as learning progresses, rats switch to an automatic, striatal-dependent response strategy (Packard & McGaugh, 1996).

Deletion of Melanin Concentrating Hormone Receptor-1 disrupts overeating in the presence of food cues.

Exposure to environmental cues associated with food can evoke eating behavior in the absence of hunger. This capacity for reward cues to promote feeding behaviors under sated conditions can be examined in the laboratory using cue-potentiated feeding (CPF). The orexigenic neuropeptide Melanin Concentrating Hormone (MCH) is expressed throughout brain circuitry critical for CPF.

Amygdalo-striatal interaction in the enhancement of stimulus salience in associative learning.

Function of the central nucleus of the amygdala (CeA) is critical to 2 aspects of attention in associative learning: the conditioning of orienting responses (ORs) to cues paired with food, and the enhancement of cue salience by the surprising omission of expected events. Such salience enhancements have been found to depend on interactions within a circuit that includes CeA, the substantia nigra pars compacta (SNc), the substantia innominata (SI), and the posterior parietal cortex (PPC). The acquisition and expression of conditioned ORs requires interactions among CeA, SNc, and the dorsal lateral striatum (DLS), but not SI or PPC.

Stimuli associated with the cancellation of food and its cues enhance eating but display negative incentive value.

Initially neutral conditioned stimuli paired with food often acquire motivating properties, including serving as secondary reinforcers, enhancing instrumental responding in Pavlovian-instrumental transfer procedures, and potentiating food consumption under conditions of food satiation. Interestingly, cues associated with the cancellation of food and food cues may also potentiate food consumption (e.g.

The basolateral amygdala is necessary for negative prediction errors to enhance cue salience, but not to produce conditioned inhibition.

Behavioral evidence shows that prediction errors (PEs) not only drive associative learning, but also enhance the salience of predictive cues, making them better able to capture attention when they are next encountered. Research from our laboratory suggests that this latter consequence of PEs depends on a neural circuit that includes the amygdala. Lesions of the basolateral complex of the amygdala (BLA), for instance, selectively disrupt enhancements in cue processing that are normally induced by positive PEs without compromising simple excitatory learning.

Role of lateral hypothalamus in two aspects of attention in associative learning.

Orexin (hypocretin) and melanin-concentrating hormone (MCH) neurons are unique to the lateral hypothalamic (LH) region, but project throughout the brain. These cell groups have been implicated in a variety of functions, including reward learning, responses to stimulants, and the modulation of attention, arousal and the sleep/wakefulness cycle. Here, we examined roles for LH in two aspects of attention in associative learning shown previously to depend on intact function in major targets of orexin and MCH neurons.

Role of amygdala central nucleus in the potentiation of consuming and instrumental lever-pressing for sucrose by cues for the presentation or interruption of sucrose delivery in rats.

Initially neutral conditioned stimuli (CSs) paired with food often acquire motivating properties. For example, CS presentations may enhance the rate of instrumental responding that normally earns that food reward (Pavlovian-instrumental transfer), or potentiate consumption of that food when the animal is food-sated. Recent evidence suggests that cues associated with the withdrawal of food and food cues (interruption stimuli or ISs) may also potentiate feeding, despite exhibiting some characteristics of conditioned inhibition.

Immediate response strategy and shift to place strategy in submerged T-maze.

A considerable amount of research has demonstrated that animals can use different strategies when learning about, and navigating within, their environment. Since the influential research of Packard and McGaugh (1996), it has been widely accepted that, early in learning, rats use a flexible dorsal hippocampal-dependent place strategy. As learning progresses, they switch to a less effortful and more automatic dorsolateral caudate-dependent response strategy.

Posterior parietal cortex is critical for the encoding, consolidation, and retrieval of a memory that guides attention for learning.

Within most contemporary learning theories, reinforcement prediction error, the difference between the obtained and expected reinforcer value, critically influences associative learning. In some theories, this prediction error determines the momentary effectiveness of the reinforcer itself, such that the same physical event produces more learning when its presentation is surprising than when it is expected. In other theories, prediction error enhances attention to potential cues for that reinforcer by adjusting cue-specific associability parameters, biasing the processing of those stimuli so that they more readily enter into new associations in the future.

Blocking in autoshaped lever-pressing procedures with rats.

Rats will approach and contact a lever whose insertion into the chamber signals response-independent food delivery. This "autoshaping" or "sign-tracking" phenomenon has recently attracted considerable attention as a platform for studying individual differences in impulsivity, drug sensitization, and other traits associated with vulnerability to drug addiction. Here, we examined two basic stimulus selection phenomena-blocking and overshadowing-in the autoshaped lever pressing of rats.

Effects of nucleus accumbens core and shell lesions on autoshaped lever-pressing.

Certain Pavlovian conditioned stimuli (CSs) paired with food unconditioned stimuli (USs) come to elicit approach and even consumption-like behaviors in rats (sign-tracking). We investigated the effects of lesions of the nucleus accumbens core (ACbC) or shell (ACbS) on the acquisition of sign-tracking in a discriminative autoshaping procedure in which presentation of one lever CS was followed by delivery of sucrose, and another was not. Although we previously found that bilateral lesions of the whole ACb disrupted the initial acquisition of sign-tracking, neither ACbC or ACbS lesions affected the rate or percentage of trials in which rats pressed the CS+.

Effects of ventral striatal lesions on first- and second-order appetitive conditioning.

Rats with bilateral lesions of the ventral striatal nucleus accumbens failed to acquire Pavlovian second-order conditioning to auditory stimuli paired with visual stimuli that had previously received first-order pairings with food. This deficit in second-order conditioning was specific to learning driven by incentive properties of the first-order cues, and was observed whether the first-order training had occurred prior to or after lesion surgery. Lesions also produced deficits in the display of conditioned responses to the first-order conditioned stimulus, but only when they were made after first-order training.

Role of medial prefrontal cortex Narp in the extinction of morphine conditioned place preference.

Narp knockout (KO) mice demonstrate an impaired extinction of morphine conditioned place preference (CPP). Because the medial prefrontal cortex (mPFC) has been implicated in extinction learning, we tested whether Narp cells in this region play a role in the extinction of morphine CPP. We found that intracranial injections of adenoassociated virus (AAV) expressing wild-type (WT) Narp into the mPFC of Narp KO mice rescued the extinction and the injection of AAV expressing a dominant negative form of Narp (NarpN) into the mPFC of WT mice impaired the extinction of morphine CPP.