This paper introduces a kernel adaptive filter implemented with stochastic gradient on temporal differences, kernel Temporal Difference (TD)(λ), to estimate the state-action value function in reinforcement learning. The case λ=0 will be studied in this paper. Experimental results show the method's applicability for learning motor state decoding during a center-out reaching task performed by a monkey. The results are compared to the implementation of a time delay neural network (TDNN) trained with backpropagation of the temporal difference error. From the experiments, it is observed that kernel TD(0) allows faster convergence and a better solution than the neural network.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1109/IEMBS.2011.6091370 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Shared and Unique Neural Codes for Biological Motion Perception in Humans and Macaque Monkeys.
Adv Sci (Weinh)
March 2025
State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, China.
Throughout evolution, living organisms have honed the ability to swiftly recognize biological motion (BM) across species. However, how the brain processes within- and cross-species BM, and the evolutionary progression of these processes, remain unclear. To investigate these questions, the current study examined brain activity in the lateral temporal areas of humans and monkeys as they passively observed upright and inverted human and macaque BM stimuli.
View Article and Find Full Text PDFCryopreservation protocol for cowpea pollen storage.
Cryo Letters
March 2025
ICAR-National Bureau of Plant Genetic Resources (NBPGR); National Agricultural Higher Education Project, Indian Council of Agricultural Research (ICAR), New Delhi-110012, India.
Background: Long-term storage of cowpea pollen is important for the fertilization of spatially or temporally isolated female parents, especially during cowpea crop improvement and wide hybridization programs.
Objective: Experiments were conducted to determine pollen longevity at different storage temperatures and to develop a cryopreservation protocol for pollen of different cowpea accessions.
Materials And Methods: The investigation was carried out at the Research Farm of ICAR-NBPGR, New Delhi, India, during the kharif (rainy) season of 2022.
On the calculation of carbon and nutrient transport to the oceans.
Sci Rep
March 2025
Department of Oceanography and Coastal Sciences, Louisiana State University, Baton Rouge, LA, 70803, USA.
Correct estimations of sediment, carbon, and nutrient fluxes are crucial for understanding the impacts of land use, environmental change, and climate change. However, limited measurements-often restricted to surface data or aliased data, i.e.
View Article and Find Full Text PDFTrauma and anxiety interactions relate to reward processing in adolescents.
J Affect Disord
March 2025
Department of Psychology, San Diego State University, San Diego, CA 92182, USA; San Diego State University, University of California San Diego Joint Doctoral Program in Clinical Psychology, USA. Electronic address:
Anxiety is highly prevalent among adolescents, often linked to trauma exposure. However, not all youth with trauma develop anxiety, suggesting variability in risk pathways. This study investigates how neural reward system alterations may signal vulnerability to anxiety following trauma.
View Article and Find Full Text PDFEnvironmental justice implications of hydraulic fracturing: A spatio-temporal analysis in texas.
J Environ Manage
March 2025
Keough School of Global Affairs, University of Notre Dame, Notre Dame, IN, USA. Electronic address:
This study contributes to the field of environmental justice by addressing two key questions: (1) To what extent are racial and ethnic composition, socio-demographic characteristics, and housing-related factors associated with the siting of hydraulic fracturing wells in the U.S.? and (2) How have these associations evolved over time, and have demographic changes contributed to increased environmental justice concerns? Using a panel dataset from FracFocus and the American Community Survey at the census-tract level between 2011 and 2023, the findings reveal that hydraulic fracturing wells are disproportionately located near census tracts with higher percentages of Black and Hispanic populations, indicating environmental injustice towards racial minorities.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!