Reinforcement learning of adaptive control strategies.

Commun Psychol

Department of Experimental Psychology, Ghent University, Henri Dunantlaan 2, 9000, Ghent, Belgium.

Published: January 2024

Humans can up- or downregulate the degree to which they rely on task information for goal-directed behaviour, a process often referred to as cognitive control. Adjustments in cognitive control are traditionally studied in response to experienced or expected task-rule conflict. However, recent theories suggest that people can also learn to adapt control settings through reinforcement. Across three preregistered task switching experiments (n = 415), we selectively rewarded correct performance on trials with either more (incongruent) or less (congruent) task-rule conflict. Results confirmed the hypothesis that people rewarded more on incongruent trials showed smaller task-rule congruency effects, thus optimally adapting their control settings to the reward scheme. Using drift diffusion modelling, we further show that this reinforcement of cognitive control may occur through conflict-dependent within-trial adjustments of response thresholds after conflict detection. Together, our findings suggest that, while people remain more efficient at learning stimulus-response associations through reinforcement, they can similarly learn cognitive control strategies through reinforcement.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11332247PMC
http://dx.doi.org/10.1038/s44271-024-00055-yDOI Listing

Publication Analysis

Top Keywords

cognitive control
16
control strategies
8
task-rule conflict
8
control settings
8
control
7
reinforcement
5
reinforcement learning
4
learning adaptive
4
adaptive control
4
strategies humans
4

Similar Publications

To understand the action mechanism of probiotics against postmenopausal symptoms, we examined the effects of Lactococcus lactis P32 (P) and Bifidobacterium bifidum P45 (P), which suppressed interleukin (IL)-6 and receptor activator of nuclear factor-κB (RANK) ligand (RNAKL) expression in Gardnerella vaginalis (Gv)-stimulated macrophages, on vaginitis, osteoporosis, and depression/cognitive impairment (DC) in mice with vaginally infected Gv, ovariectomy (Ov), or Ov/Gv (oG). Oral administration of P or P decreased Gv-induced DC-like behavior and tumor necrosis factor (TNF)-α, IL-6, RANK, and/or RANKL expression in the vagina, bone, hypothalamus, hippocampus, and colon, while Gv-suppressed bone osteoprotegerin and brain serotonin and brain-derived neurotrophic factor (BDNF) levels increased. They partially shifted vaginal and gut dysbiosis in Gv-infected mice to the gut microbiota composition in normal control mice.

View Article and Find Full Text PDF

In a series of studies on blood-brain barrier transportable peptides, a soybean dipeptide, Tyr-Pro, penetrated the mouse brain parenchyma after oral intake and improved short and long memory impairment in acute Alzheimer's model mice. Here, we aimed to clarify the anti-dementia effects of this peptide administered to SAMP8 mice prior to dementia onset. At the end of the 25-week protocol in 16-week-old SAMP8 mice, Tyr-Pro (10 mg/kg/day) significantly improved the reduced spatial learning ability compared with that in the control and amino acid (Tyr + Pro) groups as indicated by the results of Morris water maze tests conducted for five consecutive days.

View Article and Find Full Text PDF

Reconfiguration of brain network dynamics in bipolar disorder: a hidden Markov model approach.

Transl Psychiatry

December 2024

School of Computer Science and Technology (School of Data Science), Taiyuan University of Technology, Taiyuan, 030024, China.

Bipolar disorder (BD) is a neuropsychiatric disorder characterized by severe disturbance and fluctuation in mood. Dynamic functional connectivity (dFC) has the potential to more accurately capture the evolving processes of emotion and cognition in BD. Nevertheless, prior investigations of dFC typically centered on larger time scales, limiting the sensitivity to transient changes.

View Article and Find Full Text PDF

Background And Purpose: In idiopathic normal pressure hydrocephalus (iNPH) patients, cerebrospinal fluid (CSF) flow is typically evaluated with a cardiac-gated two-dimensional (2D) phase-contrast (PC) MRI through the cerebral aqueduct. This approach is limited by the evaluation of a single location and does not account for respiration effects on flow. In this study, we quantified the cardiac and respiratory contributions to CSF movement at multiple intracranial locations using a real-time 2D PC-MRI and evaluated the diagnostic value of CSF dynamics biomarkers in classifying iNPH patients.

View Article and Find Full Text PDF

Background: Atrial fibrillation (AF) is associated with cognitive decline. Use of oral anticoagulant (OAC) medications offers a lower risk of dementia, but it is unclear whether differences exist between types of OAC agents.

Objective: This was a secondary analysis to explore whether the progression from normal cognition to mild cognitive impairment to dementia differs between adults with AF on warfarin versus non-vitamin K inhibitors medications (NOACs) using data extracted from the National Alzheimer's Coordinating Center clinical case series.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!