We designed a grid world task to study human planning and re-planning behavior in an unknown stochastic environment. In our grid world, participants were asked to travel from a random starting point to a random goal position while maximizing their reward. Because they were not familiar with the environment, they needed to learn its characteristics from experience to plan optimally. Later in the task, we randomly blocked the optimal path to investigate whether and how people adjust their original plans to find a detour. To this end, we developed and compared 12 different models. These models were different on how they learned and represented the environment and how they planned to catch the goal. The majority of our participants were able to plan optimally. We also showed that people were capable of revising their plans when an unexpected event occurred. The result from the model comparison showed that the model-based reinforcement learning approach provided the best account for the data and outperformed heuristics in explaining the behavioral data in the re-planning trials.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.cogpsych.2017.12.002 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Performance Analysis and Design Principles of Wireless Mutual Broadcast Using Heterogeneous Transmit Power for Proximity-Aware Services.
Sensors (Basel)
December 2024
Department of Mobile Systems Engineering, Dankook University, Yongin 16890, Republic of Korea.
As proximity-aware services among devices such as sensors, IoT devices, and user equipment are expected to facilitate a wide range of new applications in the beyond 5G and 6G era, managing heterogeneous environments with diverse node capabilities becomes essential. This paper analytically models and characterizes the performance of heterogeneous random access-based wireless mutual broadcast (RA-WMB) with distinct transmit (Tx) power levels, leveraging a marked Poisson point process to account for nodes' various Tx power. In particular, this study enables the performance of RA-WMB with heterogeneous Tx power to be represented in terms of the performance of RA-WMB with a common Tx power by deriving an equivalent Tx power based on the probability distribution of heterogeneous Tx power and the path loss exponent.
View Article and Find Full Text PDFVariations in the Bacterial, Fungal, and Protist Communities and Their Interactions Within Sediment Affected by the Benthic Organism, Snail .
Microorganisms
December 2024
Key Laboratory of Integrated Rice-Fish Farming Ecology, Ministry of Agriculture and Rural Affairs, Freshwater Fisheries Research Center, Chinese Academy of Fishery Sciences, Wuxi 214081, China.
In aquatic benthic environments, benthic organisms have been found to regulate important biogeochemical characteristics and perform key ecosystem functions. To further explore the ecological impact of the snail 's, presence on the benthic environment, we employed high-throughput sequencing technology to investigate its effects on the bacterial, fungal, and protist communities in sediment and their intrinsic interactions. Our findings revealed that 's presence significantly enhanced the diversity and evenness of the fungal community while simultaneously decreasing the diversity and richness of the protist community, and it also altered the composition and relative abundance of the dominant phyla across the bacterial, fungal, and protist communities.
View Article and Find Full Text PDFBioremediation Potential of PM1 in Sodium Selenite-Contaminated Soil and Its Impact on Microbial Community Assembly.
Microorganisms
November 2024
Hubei Key Laboratory of Biological Resources Protection and Utilization, Hubei Minzu University, Enshi 445000, China.
Soil microbial communities are particularly sensitive to selenium contamination, which has seriously affected the stability of soil ecological environment and function. In this study, we applied high-throughput 16S rRNA gene sequencing to examine the effects of low and high doses of sodium selenite and the selenite-degrading bacterium, PM1, on soil bacterial community composition, diversity, and assembly processes under controlled laboratory conditions. Our results indicated that sodium selenite and strain PM1 were key predictors of bacterial community structure in selenium-contaminated soils.
View Article and Find Full Text PDFOrnstein-Uhlenbeck Adaptation as a Mechanism for Learning in Brains and Machines.
Entropy (Basel)
December 2024
Department of Machine Learning and Neural Computing, Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6500HB Nijmegen, The Netherlands.
Learning is a fundamental property of intelligent systems, observed across biological organisms and engineered systems. While modern intelligent systems typically rely on gradient descent for learning, the need for exact gradients and complex information flow makes its implementation in biological and neuromorphic systems challenging. This has motivated the exploration of alternative learning mechanisms that can operate locally and do not rely on exact gradients.
View Article and Find Full Text PDFStochastic Entropy Production Associated with Quantum Measurement in a Framework of Markovian Quantum State Diffusion.
Entropy (Basel)
November 2024
Department of Physics and Astronomy and London Centre for Nanotechnology, University College London, Gower Street, London WC1E 6BT, UK.
The reduced density matrix that characterises the state of an open quantum system is a projection from the full density matrix of the quantum system and its environment, and there are many full density matrices consistent with a given reduced version. Without a specification of relevant details of the environment, the time evolution of a reduced density matrix is therefore typically unpredictable, even if the dynamics of the full density matrix are deterministic. With this in mind, we investigate a two-level open quantum system using a framework of quantum state diffusion.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!