Context-sensitive valuation and learning.

Curr Opin Behav Sci

Princeton University, United States.

Published: October 2021

A variety of behavioral and neural phenomena suggest that organisms evaluate outcomes not on an absolute utility scale, but relative to some dynamic and context-sensitive reference or scale. Sometimes, as in foraging tasks, this results in sensible choices; in other situations, like choosing between options learned in different contexts, irrational choices can result. We argue that what unites and demystifies these various phenomena is that the brain's goal is not assessing utility as an end in itself, but rather comparing different options to choose the better one. In the presence of uncertainty, noise, or costly computation, adjusting options to the context can produce more accurate choices.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8244390PMC
http://dx.doi.org/10.1016/j.cobeha.2021.05.001DOI Listing

Publication Analysis

Top Keywords

context-sensitive valuation
4
valuation learning
4
learning variety
4
variety behavioral
4
behavioral neural
4
neural phenomena
4
phenomena organisms
4
organisms evaluate
4
evaluate outcomes
4
outcomes absolute
4

Similar Publications

People often draw on their current affective experience to inform their decisions, yet little is known about the underlying mechanisms of this process. Understanding them has important implications for many big questions in both the affective and decision sciences. Do the same neural circuits that generate affect generate value? What differentiates people who have greater contextual flexibility in their reliance on affect? Do affective choices invoke processes that are distinct from less affective choices? To investigate these questions, we developed a neurocomputational model of affect-informed choice, in which people convert subjective affect into context-sensitive decision value through a process of weighted evidence accumulation.

View Article and Find Full Text PDF
Article Synopsis
  • The hippocampus plays a crucial role in decision-making, especially when evaluating uncertain values.
  • Individuals with autoimmune limbic encephalitis, which affects the hippocampus, showed reduced sensitivity to changes in reward and effort when faced with uncertainty, despite being able to assess them without uncertainty.
  • The findings suggest that the hippocampus is essential for making value-based decisions specifically in uncertain situations, and its damage correlates with worse performance in these scenarios.
View Article and Find Full Text PDF

Intrinsic rewards explain context-sensitive valuation in reinforcement learning.

PLoS Biol

July 2023

Department of Psychology, University of California, Berkeley, Berkeley, California, United States of America.

When observing the outcome of a choice, people are sensitive to the choice's context, such that the experienced value of an option depends on the alternatives: getting $1 when the possibilities were 0 or 1 feels much better than when the possibilities were 1 or 10. Context-sensitive valuation has been documented within reinforcement learning (RL) tasks, in which values are learned from experience through trial and error. Range adaptation, wherein options are rescaled according to the range of values yielded by available options, has been proposed to account for this phenomenon.

View Article and Find Full Text PDF

A variety of behavioral and neural phenomena suggest that organisms evaluate outcomes not on an absolute utility scale, but relative to some dynamic and context-sensitive reference or scale. Sometimes, as in foraging tasks, this results in sensible choices; in other situations, like choosing between options learned in different contexts, irrational choices can result. We argue that what unites and demystifies these various phenomena is that the brain's goal is not assessing utility as an end in itself, but rather comparing different options to choose the better one.

View Article and Find Full Text PDF

Real-world information is primarily sensory in nature, and understandably people attach value to the sensory information to prepare for appropriate behavioral responses. This review presents research from value-based, perceptual, and social decision-making domains, so far studied using isolated paradigms and their corresponding computational models. For example, in perceptual decision making, the sensory evidence accumulation rather than value computation becomes central to choice behavior.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!