Animals routinely adapt to changes in the environment in order to survive. Though reinforcement learning may play a role in such adaptation, it is not clear that it is the only mechanism involved, as it is not well suited to producing rapid, relatively immediate changes in strategies in response to environmental changes. This research proposes that counterfactual reasoning might be an additional mechanism that facilitates change detection. An experiment is conducted in which a task state changes over time and the participants had to detect the changes in order to perform well and gain monetary rewards. A cognitive model is constructed that incorporates reinforcement learning with counterfactual reasoning to help quickly adjust the utility of task strategies in response to changes. The results show that the model can accurately explain human data and that counterfactual reasoning is key to reproducing the various effects observed in this change detection paradigm.

Download full-text PDF

Source
http://dx.doi.org/10.1111/tops.12143DOI Listing

Publication Analysis

Top Keywords

counterfactual reasoning
16
reinforcement learning
12
learning counterfactual
8
strategies response
8
change detection
8
changes
6
counterfactual
4
reasoning
4
reasoning explain
4
explain adaptive
4

Similar Publications

People often think about how things could have been better or worse. People make these upward and downward comparisons in different situations and with differing emotional consequences. We investigated whether the direction of counterfactual comparisons affects people's judgements of counterfactual closeness.

View Article and Find Full Text PDF

Background: Healthcare governance (HG) is a quality assurance processes that aims to maintain and improve clinical practice. Clinical decisions are routinely reviewed after the outcome is known to learn lessons for the future. When the outcome is positive, then practice is praised, but when practice is suboptimal, the area for improvement is highlighted.

View Article and Find Full Text PDF
Article Synopsis
  • The study highlights how deep learning (DL) models are improving Alzheimer's disease diagnosis by using counterfactual inference to enhance explainability and clinical adoption.
  • A new method is proposed that combines U-Net and GAN models to create counterfactual diagnostic maps, which help in understanding how changes in brain features affect diagnosis.
  • Results show this new approach significantly outperforms existing methods, achieving 95% accuracy, and provides detailed visual explanations, making diagnostics more reliable and enhancing clinicians' understanding of disease progression.
View Article and Find Full Text PDF

Due to significant anatomical variations in medical images across different cases, medical image segmentation is a highly challenging task. Convolutional neural networks have shown faster and more accurate performance in medical image segmentation. However, existing networks for medical image segmentation mostly rely on independent training of the model using data samples and loss functions, lacking interactive training and feedback mechanisms.

View Article and Find Full Text PDF

Metacognition of perceptual resolution across and around the visual field.

Cognition

December 2024

Graduate Program in Cognitive Science, Yonsei University, South Korea; Department of Psychology, Yonsei University, South Korea. Electronic address:

Do people have accurate metacognition of non-uniformities in perceptual resolution across (i.e., eccentricity) and around (i.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!