A prominent account of decision-making assumes that information is accumulated until a fixed response threshold is crossed. However, many decisions require weighting of information appropriately against time. Collapsing response thresholds are a mathematically optimal solution to this decision problem.
View Article and Find Full Text PDFDeficits in reward learning are core symptoms across many mental disorders. Recent work suggests that such learning impairments arise by a diminished ability to use reward history to guide behaviour, but the neuro-computational mechanisms through which these impairments emerge remain unclear. Moreover, limited work has taken a transdiagnostic approach to investigate whether the psychological and neural mechanisms that give rise to learning deficits are shared across forms of psychopathology.
View Article and Find Full Text PDFPerformance monitoring (PM) is a vital component of adaptive behavior and known to be influenced by motivation. We examined effects of potential gain (PG) and loss avoidance (LA) on neural correlates of PM at different processing stages, using a task with trial-based changes in these motivational contexts. Findings suggest more attention is allocated to the PG context, with higher amplitudes for respective correlates of stimulus and feedback processing.
View Article and Find Full Text PDFOptimal decision making in complex environments requires dynamic learning from unexpected events. To speed up learning, we should heavily weight information that indicates state-action-outcome contingency changes and ignore uninformative fluctuations in the environment. Often, however, unrelated information is hard to ignore and can potentially bias our learning.
View Article and Find Full Text PDFThe feedback-related negativity (FRN) is a well-established electrophysiological correlate of feedback-processing. However, there is still an ongoing debate whether the FRN is driven by negative or positive reward prediction errors (RPE), valence of feedback, or mere surprise. Our study disentangles independent contributions of valence, surprise, and RPE on the feedback-related neuronal signal including the FRN and P3 components using the statistical power of a sample of N = 992 healthy individuals.
View Article and Find Full Text PDFWe typically slow down after committing an error, an effect termed post-error slowing (PES). Traditionally, PES has been calculated by subtracting post-correct from post-error RTs. Dutilh et al.
View Article and Find Full Text PDFBackground: Symptoms of obsessive-compulsive disorder (OCD) are partly related to impaired cognitive control processes and theta modulations constitute an important electrophysiological marker for cognitive control processes such as signaling negative performance feedback in a fronto-striatal network. Deep brain stimulation (DBS) targeting the anterior limb of the internal capsule (ALIC)/nucleus accumbens (NAc) shows clinical efficacy in OCD, while the exact influence on the performance monitoring system remains largely unknown.
Methods: Seventeen patients with treatment-refractory OCD performed a probabilistic reinforcement learning task.
Objective: Tourette syndrome is a neurodevelopmental disorder putatively associated with a hyperdopaminergic state. Therefore, it seems plausible that excessive dopamine transmission in Tourette syndrome alters the ability to learn based on rewards and punishments. We tested whether Tourette syndrome patients exhibited altered reinforcement learning and corresponding feedback-related EEG deflections.
View Article and Find Full Text PDFReinforcement learning (RL) theory states that learning is driven by prediction errors (PEs)-the discrepancy between the predicted and actual outcome of an action. When participants learn from their own actions, PEs correlate with the feedback-related negativity (FRN), but it is not clear if the FRN reflects a PE in observational learning. We use a model-based regression analysis of single-trial event-related potentials to determine if the FRN in observational learning is PE driven.
View Article and Find Full Text PDFAdapting to errors quickly is essential for survival. Reaction slowing after errors is commonly observed but whether this slowing is adaptive or maladaptive is unclear. Here, we analyse a large dataset from a flanker task using two complementary approaches: a multistage drift-diffusion model, and the lateralisation of EEG beta power as a time-resolved index of choice formation.
View Article and Find Full Text PDFWe are capable of planning ahead by incorporating dynamic factors influencing future choices. In this issue of Neuron, Kolling et al. (2018) present fMRI results of a novel task that demonstrates how humans evaluate alternative environments by prospectively incorporating their characteristics over time and account for their own decision tendencies.
View Article and Find Full Text PDFOptimal decision-making employs short-term rewards and abstract long-term information based on which of these is deemed relevant. Employing short- vs. long-term information is associated with different learning mechanisms, yet neural evidence showing that these two are dissociable is lacking.
View Article and Find Full Text PDFFront Hum Neurosci
October 2017
The specific role of serotonin and its interplay with dopamine (DA) in adaptive, reward guided behavior as well as drug dependance, still remains elusive. Recently, novel methods allowed cell type specific anatomical, functional and interventional analyses of serotonergic and dopaminergic circuits, promising significant advancement in understanding their functional roles. Furthermore, it is increasingly recognized that co-release of neurotransmitters is functionally relevant, understanding of which is required in order to interpret results of pharmacological studies and their relationship to neural recordings.
View Article and Find Full Text PDFThe error-related negativity (ERN or Ne) is increasingly being investigated as a marker discriminating interindividual factors and moves toward a surrogate marker for disorders or interventions. Although reproducibility and validity of neuroscientific and psychological research has been criticized, clear data on how different quantification methods of the ERN and their relation to available trial numbers affect within- and across-participant studies is sparse. Within a large sample of 863 healthy human participants, we demonstrate that, across participants, the number of errors correlates with the amplitude of the ERN independently of the number of errors included in ERN quantification per participant, constituting a possible confound when such variance is unaccounted for.
View Article and Find Full Text PDFSexual dimorphisms have been observed in many species, including humans, and extend to the prevalence and presentation of important mental disorders associated with performance monitoring malfunctions. However, precisely which underlying differences between genders contribute to the alterations observed in psychiatric diseases is unknown. Here, we compare behavioural and neural correlates of cognitive control functions in 438 female and 436 male participants performing a flanker task while EEG was recorded.
View Article and Find Full Text PDFSerotonin (5-HT) has been hypothesized to be implicated in performance monitoring by promoting behavioral inhibition in the face of aversive events. However, it is unclear whether this is restricted to external (punishment) or includes internal (response errors) events. The aim of the current study was to test whether higher 5-HT levels instigate inhibition specifically in the face of errors, measured as post-error slowing (PES), and whether this is represented in electrophysiological correlates of error processing, namely error-related negativity (ERN) and positivity.
View Article and Find Full Text PDFThe brain's serotonergic (5-HT) system has been implicated in controlling impulsive behavior and attentional orienting and linked to impulse control and anxiety related disorders. However, interactions between genotypical variation and responses to serotonergic drugs impede both treatment efficacy and neuroscientific research. We examine behavioral and electrophysiological responses to acute intravenous administration of a selective serotonin reuptake inhibitor (SSRI) while controlling for major genetic differences regarding 5-HT transporter (5-HTT) genotypes.
View Article and Find Full Text PDFTrends Cogn Sci
December 2014
Neuroscientists have been puzzled by the fact that acute administration of a selective serotonin reuptake inhibitor (SSRI) produces results that are, at times, compatible with either decreases or increases in serotonergic neurotransmission. Furthermore, the underlying cause of the delayed onset of antidepressant effects of SSRI treatment has remained obscure. It has recently been reported that serotonergic raphe neurons co-release glutamate and that serotonergic and glutamatergic components constitute a dual signal with behaviorally distinct effects.
View Article and Find Full Text PDFHumans flexibly weight incoming evidence when updating beliefs and adjusting behavior. In the current issue of Neuron, McGuire et al. (2014) show how distinct neuronal correlates of main factors underlying this weighting converge on a common mechanism driving belief updates.
View Article and Find Full Text PDFSuccessful goal-directed behavior critically depends on performance monitoring, a set of cognitive and affective functions determining whether adaptive control is needed and, if so, which type and magnitude is required. Knowledge of the brain structures involved in such a process has grown enormously, although the time course of performance-monitoring (PM) activity remains poorly understood. Here, we review evidence from EEG recordings in humans and show that monitored events elicit a rather uniform sequence of cortical activity reflecting the detection, accumulation, and weighting of evidence for the necessity to adapt and (re)act.
View Article and Find Full Text PDFThe ability to learn not only from experienced but also from merely fictive outcomes without direct rewarding or punishing consequences should improve learning and resulting value-guided choice. Using an instrumental learning task in combination with multiple single-trial regression of predictions derived from a computational reinforcement-learning model on human EEG, we found an early temporospatial double dissociation in the processing of fictive and real feedback. Thereafter, real and fictive feedback processing converged at a common final path, reflected in parietal EEG activity that was predictive of future choices.
View Article and Find Full Text PDFFollowing recent advances in neuromodulation therapy for mental disorders, we treated one patient with severe alcohol addiction with deep brain stimulation (DBS) of the nucleus accumbens (NAc). Before and one year following the surgery, we assessed the effects of DBS within the NAc on the addiction as well as on psychometric scores and electrophysiological measures of cognitive control. In our patient, DBS achieved normalization of addictive behavior and craving.
View Article and Find Full Text PDF