Influence of surprise on reinforcement learning in younger and older adults.

Surprise is a key component of many learning experiences, and yet its precise computational role, and how it changes with age, remain debated. One major challenge is that surprise often occurs jointly with other variables, such as uncertainty and outcome probability. To assess how humans learn from surprising events, and whether aging affects this process, we studied choices while participants learned from bandits with either Gaussian or bi-modal outcome distributions, which decoupled outcome probability, uncertainty, and surprise.

Reduction of Aversive Learning Rates in Pavlovian Conditioning by Angiotensin II Antagonist Losartan: A Randomized Controlled Trial.

Background: Angiotensin receptor blockade has been linked to aspects of aversive learning and memory formation and to the prevention of posttraumatic stress disorder symptom development.

Methods: We investigated the influence of the angiotensin receptor blocker losartan on aversive Pavlovian conditioning using a probabilistic learning paradigm. In a double-blind, randomized, placebo-controlled design, we tested 45 (18 female) healthy volunteers during a baseline session, after application of losartan or placebo (drug session), and during a follow-up session.

Better late than never: sleep still supports memory consolidation after prolonged periods of wakefulness.

While the benefits of sleep for associative memory are well established, it is unclear whether single-item memories profit from overnight consolidation to the same extent. We addressed this question in a preregistered, online study and also investigated how the temporal proximity between learning and sleep influences overnight retention. Sleep relative to wakefulness improved retention of item and associative memories to similar extents irrespective of whether sleep occurred soon after learning or following a prolonged waking interval.

Trait anxiety is associated with hidden state inference during aversive reversal learning.

Updating beliefs in changing environments can be driven by gradually adapting expectations or by relying on inferred hidden states (i.e. contexts), and changes therein.

Impaired adaptation of learning to contingency volatility in internalizing psychopathology.

Using a contingency volatility manipulation, we tested the hypothesis that difficulty adapting probabilistic decision-making to second-order uncertainty might reflect a core deficit that cuts across anxiety and depression and holds regardless of whether outcomes are aversive or involve reward gain or loss. We used bifactor modeling of internalizing symptoms to separate symptom variance common to both anxiety and depression from that unique to each. Across two experiments, we modeled performance on a probabilistic decision-making under volatility task using a hierarchical Bayesian framework.

Stratification of MDD and GAD patients by resting state brain connectivity predicts cognitive bias.

Patients with Generalized Anxiety Disorder (GAD) and Major Depressive Disorder (MDD) show between-group comorbidity and symptom overlap, and within-group heterogeneity. Resting state functional connectivity might provide an alternate, biologically informed means by which to stratify patients with GAD or MDD. Resting state functional magnetic resonance imaging data were acquired from 23 adults with GAD, 21 adults with MDD, and 27 healthy adult control participants.

Second language feedback abolishes the "hot hand" effect during even-probability gambling.

Research into language-emotion interactions has revealed intriguing cognitive inhibition effects by emotionally negative words in bilinguals. Here, we turn to the domain of human risk taking and show that the experience of positive recency in games of chance-the "hot hand" effect-is diminished when game outcomes are provided in a second language rather than the native language. We engaged late Chinese-English bilinguals with "play" or "leave" decisions upon presentation of equal-odds bets while manipulating language of feedback and outcome value.

Characterizing the associative content of brain structures involved in habitual and goal-directed actions in humans: a multivariate FMRI study.

While there is accumulating evidence for the existence of distinct neural systems supporting goal-directed and habitual action selection in the mammalian brain, much less is known about the nature of the information being processed in these different brain regions. Associative learning theory predicts that brain systems involved in habitual control, such as the dorsolateral striatum, should contain stimulus and response information only, but not outcome information, while regions involved in goal-directed action, such as ventromedial and dorsolateral prefrontal cortex and dorsomedial striatum, should be involved in processing information about outcomes as well as stimuli and responses. To test this prediction, human participants underwent fMRI while engaging in a binary choice task designed to enable the separate identification of these different representations with a multivariate classification analysis approach.