Optimal policy for value-based decision-making.

Nat Commun

Département des Neurosciences Fondamentales, University of Geneva, Rue Michel-Servet 1, Genève 1211, Switzerland.

Published: August 2016

For decades now, normative theories of perceptual decisions, and their implementation as drift diffusion models, have driven and significantly improved our understanding of human and animal behaviour and the underlying neural processes. While similar processes seem to govern value-based decisions, we still lack the theoretical understanding of why this ought to be the case. Here, we show that, similar to perceptual decisions, drift diffusion models implement the optimal strategy for value-based decisions. Such optimal decisions require the models' decision boundaries to collapse over time, and to depend on the a priori knowledge about reward contingencies. Diffusion models only implement the optimal strategy under specific task assumptions, and cease to be optimal once we start relaxing these assumptions, by, for example, using non-linear utility functions. Our findings thus provide the much-needed theory for value-based decisions, explain the apparent similarity to perceptual decisions, and predict conditions under which this similarity should break down.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4992126PMC
http://dx.doi.org/10.1038/ncomms12400DOI Listing

Publication Analysis

Top Keywords

perceptual decisions
12
diffusion models
12
value-based decisions
12
drift diffusion
8
models implement
8
implement optimal
8
optimal strategy
8
decisions
7
optimal
5
optimal policy
4

Similar Publications

Diabetes increases the risk of dementia, and insulin resistance (IR) has emerged as a potential unifying feature. Here, we review published findings over the past 2 decades on the relation of diabetes and IR to brain health, including those related to cognition and neuropathology, in the Religious Orders Study, the Rush Memory and Aging Project, and the Minority Aging Research Study (ROS/MAP/MARS), three harmonised cohort studies of ageing and dementia at the Rush Alzheimer's Disease Center (RADC). A wide range of participant data, including information on medical conditions such as diabetes and neuropsychological tests, as well as other clinical and laboratory-based data collected annually.

View Article and Find Full Text PDF

Readiness for Perception and Action: Towards a More Mechanistic Understanding of Phasic Alertness.

J Cogn

January 2025

Neuro-Cognitive Psychology, Department of Psychology, Bielefeld University, Bielefeld, Germany.

Human survival requires prompt perception and action to address relevant events in the environment. For this, the brain has evolved a system that uses warning stimuli to elicit phasic alertness, a state readying the brain for upcoming perception and action. Although a wealth of empirical evidence revealed how phasic alertness improves a wide range of perceptual and cognitive processing, it is still unclear by what cognitive mechanisms this is achieved.

View Article and Find Full Text PDF

Digital health (DH) and artificial intelligence (AI) in healthcare are rapidly evolving but were addressed synonymously by many healthcare authorities and practitioners. A deep understanding and clarification of these concepts are fundamental and a prerequisite for developing robust frameworks and practical guidelines to ensure the safety, efficacy, and effectiveness of DH solutions and AI-embedded technologies. Categorizing DH into technologies (DHTs) and services (DHSs) enables regulatory, HTA, and reimbursement bodies to develop category-specific frameworks and guidelines for evaluating these solutions effectively.

View Article and Find Full Text PDF

Factors influencing shared decision-making on hospital wards as perceived by healthcare professionals: A qualitative study.

Appl Nurs Res

February 2025

Nursing Science, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, 3584 CX Utrecht, the Netherlands; School of Health Sciences, Faculty of Environmental and Life Sciences, University of Southampton, UK.

Objectives: The extent to which healthcare professionals apply Shared Decision Making (SDM) on hospital wards is still unknown. The aim was to explore the current knowledge of SDM among healthcare professionals and the experienced factors influencing SDM on the wards of Dutch hospitals, regarding both treatment and care decisions.

Setting: Twelve hospital wards in two university medical centres and one teaching hospital.

View Article and Find Full Text PDF

Decision confidence plays a critical role in humans' ability to make adaptive decisions in a noisy perceptual world. Despite its importance, there is currently little consensus about the computations underlying confidence judgements in perceptual decisions. To better understand these mechanisms, we addressed the extent to which confidence is informed by a naturalistic prior distribution.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!