Biologically plausible models of learning may provide a crucial insight for building autonomous intelligent agents capable of performing a wide range of tasks. In this work, we propose a hierarchical model of an agent operating in an unfamiliar environment driven by a reinforcement signal. We use temporal memory to learn sparse distributed representation of state-actions and the basal ganglia model to learn effective action policy on different levels of abstraction. The learned model of the environment is utilized to generate an intrinsic motivation signal, which drives the agent in the absence of the extrinsic signal, and through acting in imagination, which we call dreaming. We demonstrate that the proposed architecture enables an agent to effectively reach goals in grid environments.
Download full-text PDF |
Source |
---|---|
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8976870 | PMC |
http://dx.doi.org/10.1186/s40708-022-00156-6 | DOI Listing |
Environ Sci Technol
January 2025
Department of Civil and Environmental Engineering, Stanford University, 473 Via Ortega, Stanford, California 94305, United States.
Significant hourly variation in the carbon intensity of electricity supplied to wastewater facilities introduces an opportunity to lower emissions by shifting the timing of their energy demand. This shift could be accomplished by storing wastewater, biogas from sludge digestion, or electricity from on-site biogas generation. However, the life cycle emissions and cost implications of these options are not clear.
View Article and Find Full Text PDFJ Environ Health Sci Eng
June 2025
School of Municipal and Environmental Engineering, Shandong Jianzhu University, Jinan, 250101 P. R. China.
Unlabelled: The presence of bromate in water poses a significant health risk. In order to effectively eliminate bromate from water, this study synthesized a series of ternary Zn-Ni-Al layered double hydroxides with varying Zn/Ni/Al atomic ratios using a co-precipitation method. The adsorbents were characterized using various techniques including XRD, Fourier transform infrared spectroscopy, and N adsorption-desorption isotherms.
View Article and Find Full Text PDFJ Mamm Evol
January 2025
Department of Chemical and Biological Sciences, Youngstown State University, Youngstown, OH USA.
Unlabelled: Remains of megatheres have been known since the 18th -century and were among the first megafaunal vertebrates to be studied. While several examples of preserved integument show a thick coverage of fur for smaller ground sloths living in cold climates such as and , comparatively very little is known about megathere skin. Assuming a typical placental mammal metabolism, it was previously hypothesized that megatheres would have had little-to-no fur as they achieved giant body sizes.
View Article and Find Full Text PDFEnviron Epidemiol
February 2025
Department of Public Health Sciences, University of Rochester Medical Center, Rochester, New York.
Background: Sex steroid hormones are critical for maintaining pregnancy and optimal fetal development. Air pollutants are potential endocrine disruptors that may disturb sex steroidogenesis during pregnancy, potentially leading to adverse health outcomes.
Methods: In the Environmental influences on Child Health Outcomes Understanding Pregnancy Signals and Infant Development pregnancy cohort (Rochester, NY), sex steroid concentrations were collected at study visits in early-, mid-, and late-pregnancy in 299 participants.
Nat Geosci
January 2025
School of Earth and Environment, University of Leeds, Leeds, UK.
Controls on organic carbon preservation in marine sediments remain controversial but crucial for understanding past and future climate dynamics. Here we develop a conceptual-mathematical model to determine the key processes for the preservation of organic carbon. The model considers the major processes involved in the breakdown of organic carbon, including dissolved organic carbon hydrolysis, mixing, remineralization, mineral sorption and molecular transformation.
View Article and Find Full Text PDFEnter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!