The effect of prediction error on overt attention and learning in humans.

It has been suggested that attention modulates the speed at which cues come to predict contingent outcomes, and that attention changes with the prediction errors generated by cues. Evidence for this interaction in humans is inconsistent, with divergent findings depending on whether attention was measured with eye fixations or learning speed. We included both measures in our experiment.

Evidence for two attentional mechanisms during learning.

We sought to provide evidence for a combined effect of two attentional mechanisms during associative learning. Participants' eye movements were recorded as they predicted the outcomes following different pairs of cues. Across the trials of an initial stage, a relevant cue in each pair was consistently followed by one of two outcomes, while an irrelevant cue was equally followed by either of them.

Positive affective states can play the role of context to renew extinguished instrumental behavior in rats.

In one experiment with rats, we examined whether positive affective states can serve as contexts in a between-subjects ABA renewal design using appetitive instrumental conditioning. Two groups of rats received training to press a lever for food where each acquisition session was preceded by administration of a tickling procedure (Context A) known to induce positive affective states. Then, lever pressing underwent extinction where rats received a pure handling treatment (Context B) before each session.

A rise in prediction error increases attention to irrelevant cues.

We investigated whether a sudden rise in prediction error widens an individual's focus of attention by increasing ocular fixations on cues that otherwise tend to be ignored. To this end, we used a discrimination learning task including cues that were either relevant or irrelevant for predicting the outcomes. Half of participants experienced contingency reversal once they had learned to predict the outcomes (reversal group, n = 30).

Reduced emission of alarm 22-kHz ultrasonic vocalizations during fear conditioning in rats lacking the serotonin transporter.

Rats display a rich social behavioral repertoire. An important component of this repertoire is the emission of whistle-like calls in the ultrasonic range, so-called ultrasonic vocalizations (USV). Long low-frequency 22-kHz USV occur in aversive situations, including aggressive interactions, predator exposure, and electric shocks during fear conditioning.

Extinction of cognitive associations is preserved in patients with cerebellar disease.

In the present study extinction and renewal of cognitive associations were assessed in two experiments in participants with focal and degenerative cerebellar disease. Using a predictive learning task, participants had to learn by trial and error the relationships between food items and the occurrence of stomach trouble in a hypothetical patient. In the first experiment, focus was on renewal effects.

Transfer of associability and relational structure in human associative learning.

A wealth of recent studies have demonstrated that predictive cues involved in a linearly solvable component discrimination gain associability in subsequent learning relative to nonpredictive cues. In contrast, contradictory findings have been reported about the fate of cues involved in learning biconditional discriminations in which the cues are relevant but none are individually predictive of a specific outcome. In 3 experiments we examined the transfer of learning from component and biconditional discriminations in a within-subjects design.

Removing but not adding elements of a context affects generalization of instrumental responses.

Three experiments with rats investigated whether adding or removing elements of a context affects generalization of instrumental behavior. Each of the experiments used a free operant procedure. In Experiments 1 and 2, rats were trained to press a lever for food in a distinctive context.

Reward Draws the Eye, Uncertainty Holds the Eye: Associative Learning Modulates Distractor Interference in Visual Search.

Stimuli in our sensory environment differ with respect to their physical salience but moreover may acquire motivational salience by association with reward. If we repeatedly observed that reward is available in the context of a particular cue but absent in the context of another cue the former typically attracts more attention than the latter. However, we also may encounter cues uncorrelated with reward.

A test for a difference in the associability of blocked and uninformative cues in human predictive learning.

In human predictive learning, blocking, A+ AB+, and a simple discrimination, UX+ VX-, result in a stronger response to the blocked, B, than the uninformative cue, X (where letters represent cues and + and - represent different outcomes). To assess whether these different treatments result in more attention being paid to blocked than uninformative cues, Stage 1 in each of three experiments generated two blocked cues, B and E, and two uninformative cues, X and Y. In Stage 2, participants received two simple discriminations: either BX+ EX- and BY+ EY-, or BX+ BY- and EX+ EY-.

A reminder of extinction reduces relapse in an animal model of voluntary behavior.

One experiment with rats explored whether an extinction-cue prevents the recovery of extinguished lever-pressing responses. Initially, rats were trained to perform one instrumental response (R1) for food in Context A, and a different instrumental response (R2) in Context B. Then, responses were extinguished each in the alternate context (R1 in Context B; R2 in Context A).