Biologically plausible models of learning may provide a crucial insight for building autonomous intelligent agents capable of performing a wide range of tasks. In this work, we propose a hierarchical model of an agent operating in an unfamiliar environment driven by a reinforcement signal. We use temporal memory to learn sparse distributed representation of state-actions and the basal ganglia model to learn effective action policy on different levels of abstraction. The learned model of the environment is utilized to generate an intrinsic motivation signal, which drives the agent in the absence of the extrinsic signal, and through acting in imagination, which we call dreaming. We demonstrate that the proposed architecture enables an agent to effectively reach goals in grid environments.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8976870PMC
http://dx.doi.org/10.1186/s40708-022-00156-6DOI Listing

Publication Analysis

Top Keywords

grid environments
8
hierarchical intrinsically
4
intrinsically motivated
4
agent
4
motivated agent
4
agent planning
4
planning behavior
4
behavior dreaming
4
dreaming grid
4
environments biologically
4

Similar Publications

Load-Shifting Strategies for Cost-Effective Emission Reductions at Wastewater Facilities.

Environ Sci Technol

January 2025

Department of Civil and Environmental Engineering, Stanford University, 473 Via Ortega, Stanford, California 94305, United States.

Significant hourly variation in the carbon intensity of electricity supplied to wastewater facilities introduces an opportunity to lower emissions by shifting the timing of their energy demand. This shift could be accomplished by storing wastewater, biogas from sludge digestion, or electricity from on-site biogas generation. However, the life cycle emissions and cost implications of these options are not clear.

View Article and Find Full Text PDF

Unlabelled: The presence of bromate in water poses a significant health risk. In order to effectively eliminate bromate from water, this study synthesized a series of ternary Zn-Ni-Al layered double hydroxides with varying Zn/Ni/Al atomic ratios using a co-precipitation method. The adsorbents were characterized using various techniques including XRD, Fourier transform infrared spectroscopy, and N adsorption-desorption isotherms.

View Article and Find Full Text PDF

Unlabelled: Remains of megatheres have been known since the 18th -century and were among the first megafaunal vertebrates to be studied. While several examples of preserved integument show a thick coverage of fur for smaller ground sloths living in cold climates such as and , comparatively very little is known about megathere skin. Assuming a typical placental mammal metabolism, it was previously hypothesized that megatheres would have had little-to-no fur as they achieved giant body sizes.

View Article and Find Full Text PDF

Background: Sex steroid hormones are critical for maintaining pregnancy and optimal fetal development. Air pollutants are potential endocrine disruptors that may disturb sex steroidogenesis during pregnancy, potentially leading to adverse health outcomes.

Methods: In the Environmental influences on Child Health Outcomes Understanding Pregnancy Signals and Infant Development pregnancy cohort (Rochester, NY), sex steroid concentrations were collected at study visits in early-, mid-, and late-pregnancy in 299 participants.

View Article and Find Full Text PDF

Controls on organic carbon preservation in marine sediments remain controversial but crucial for understanding past and future climate dynamics. Here we develop a conceptual-mathematical model to determine the key processes for the preservation of organic carbon. The model considers the major processes involved in the breakdown of organic carbon, including dissolved organic carbon hydrolysis, mixing, remineralization, mineral sorption and molecular transformation.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!