Using epsilon-greedy reinforcement learning methods to further understand ventromedial prefrontal patients' deficits on the Iowa Gambling Task.

Neural Netw

Centre for Cognitive Neuroscience and Cognitive Systems, Computing Laboratory, University of Kent, Canterbury, Kent, England, United Kingdom.

Published: August 2007

An important component of decision making is evaluating the expected result of a choice, using past experience. The way past experience is used to predict future rewards and punishments can have profound effects on decision making. The aim of this study is to further understand the possible role played by the ventromedial prefrontal cortex in decision making, using results from the Iowa Gambling Task (IGT). A number of theories in the literature offer potential explanations for the underlying cause of the deficit(s) found in bilateral ventromedial prefrontal lesion (VMF) patients on the IGT. An error-driven epsilon-greedy reinforcement learning method was found to produce a good match to both human normative and VMF patient groups from a number of studies. The model supports the theory that the VMF patients are less strategic (more explorative), which could be due to a working memory deficit, and are more reactive than healthy controls. This last aspect seems consistent with a 'myopia' for future consequences.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2007.04.026DOI Listing

Publication Analysis

Top Keywords

ventromedial prefrontal
12
decision making
12
epsilon-greedy reinforcement
8
reinforcement learning
8
iowa gambling
8
gambling task
8
vmf patients
8
learning methods
4
methods understand
4
understand ventromedial
4

Similar Publications

This pilot randomized crossover study aimed to compare the effects of stimulating various transcranial direct current stimulation (tDCS) target sites to improve dual-task performance in patients with Parkinson's disease (PD). Nineteen patients with idiopathic PD completed four sessions of 2 mA anodal tDCS for 20 min at randomly assigned sites: the primary motor cortex (M1), left dorsolateral prefrontal cortex (DLPFC), ventromedial prefrontal cortex, and sham stimulation. Anodal M1 tDCS induced statistically significant improvements in single-task and cognitive dual-task timed up and go test.

View Article and Find Full Text PDF

Self-referential belief shares common neural correlates with general belief.

Sci Rep

January 2025

Department of Clinical Psychology, Central Institute of Mental Health (ZI), Medical Faculty Mannheim J5, University of Heidelberg, 68159, Mannheim, Germany.

Belief processing and self-referential processing have been consistently associated with cortical midline structures, and cortical regions such as the vmPFC have been implicated in general belief processing. The neural correlates of self-referential belief are yet to be investigated. In this fMRI study, we presented 120 statements with trait adjectives to N = 27 healthy participants, who subsequently judged whether they believed these trait adjectives applied to themselves, a close person, or a public person.

View Article and Find Full Text PDF

Reconfigured metabolism brain network in asymptomatic Creutzfeldt-Jakob disease.

Neurobiol Dis

January 2025

Department of Neurology, Xuanwu Hospital, Capital Medical University, Beijing, China; National Clinical Research Center for Geriatric Disorders, Xuanwu Hospital, Capital Medical University, Beijing, China. Electronic address:

Background: Investigating brain metabolic networks is crucial for understanding the pathogenesis and functional alterations in Creutzfeldt-Jakob disease (CJD). However, studies on presymptomatic individuals remain limited. This study aimed to examine metabolic network topology reconfiguration in asymptomatic carriers of the PRNP G114V mutation.

View Article and Find Full Text PDF

Pivotal to self-preservation is the ability to identify when we are safe and when we are in danger. Previous studies have focused on safety estimations based on the features of external threats and do not consider how the brain integrates other key factors, including estimates about our ability to protect ourselves. Here, we examine the neural systems underlying the online dynamic encoding of safety.

View Article and Find Full Text PDF

Background: In people with substance use disorders (SUDs), stress-exposure can impair executive function, and increase craving and likelihood of drug-use recurrence. Research shows that acute stressors increase drug-seeking behavior; however, mechanisms underlying this effect are incompletely understood. The Competing Neurobehavioral Decisions System theory posits that persons with SUDs may have hyperactive limbic reward circuitry and hypoactive executive control circuitry.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!