Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10568745 | PMC |
| http://dx.doi.org/10.1186/s12964-023-01314-x | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
VCSAP: Online reinforcement learning exploration method based on visitation count of state-action pairs.
Neural Netw
January 2025
Key Laboratory of Symbolic Computation and Knowledge Engineering (Jilin University), Changchun 130012, China; College of Computer Science and Technology, Jilin University, Changchun 130012, China; College of Software, Jilin University, Changchun 130012, China. Electronic address:
In the domain of online reinforcement learning, strategies that leverage inherent rewards for exploration tend to achieve commendable outcomes within contexts characterized by deceptive or sparse rewards. Counting through the visitation of states is an efficient count-based exploration method to get the proper intrinsic reward. However, only the novelty of the states encountered by the agent is considered in this exploration method, resulting in the over-exploration of a certain state-action pair and falling into a locally optimal solution.
View Article and Find Full Text PDFFree-space optical spiking neural network.
PLoS One
January 2025
Department of Computer Engineering, Sharif University of Technology, Tehran, Iran.
Neuromorphic engineering has emerged as a promising avenue for developing brain-inspired computational systems. However, conventional electronic AI-based processors often encounter challenges related to processing speed and thermal dissipation. As an alternative, optical implementations of such processors have been proposed, capitalizing on the intrinsic information-processing capabilities of light.
View Article and Find Full Text PDFToward mitigating the impact of non-bulk defects on describing water structure in salt aqueous solutions: Characterizing solution density with a network-based structural indicator.
J Chem Phys
January 2025
State Key Laboratory of Hydroscience and Engineering, Department of Hydraulic Engineering, Tsinghua University, Beijing 100084, China.
Structural indicators, also known as structural descriptors, including order parameters, have been proposed to quantify the structural properties of water to account for its anomalous behaviors. However, these indicators, mainly designed for bulk water, are not naturally transferrable to the vicinity of ions due to disruptions in the immediate neighboring space and a resulting loss of feature completeness. To address these non-bulk defects, we introduced a structural indicator that draws on the concept of clique number from graph theory and the criterion in agglomerative clustering, denoted as the average cluster number.
View Article and Find Full Text PDFNanotwin-Induced Ferrimagnetism in an Antiferromagnetic CrO Thin Film on the SrTiO Substrate.
ACS Nano
January 2025
Shenyang National Laboratory for Materials Science, Institute of Metal Research, Chinese Academy of Sciences, Shenyang 110016, China.
Nanotwinned materials have recently attracted intense interest since they often exhibit excellent mechanical properties that are far superior to those of the corresponding single crystals. However, how nanotwinned structures affect the physical properties of functional materials remains almost unexplored. In this study, we demonstrate ferrimagnetism in a nanotwinned antiferromagnetic CrO thin film.
View Article and Find Full Text PDFSpike frequency adaptation in primate lateral prefrontal cortex neurons results from interplay between intrinsic properties and circuit dynamics.
Cell Rep
January 2025
Department of Clinical Neurological Sciences, London Health Sciences Centre, Western University, London, ON, Canada; Department of Physiology and Pharmacology, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada; Western Institute for Neuroscience, Western University, London, ON, Canada.
Cortical neurons in brain slices display intrinsic spike frequency adaptation (I-SFA) to constant current inputs, while extracellular recordings show extrinsic SFA (E-SFA) during sustained visual stimulation. Inferring how I-SFA contributes to E-SFA during behavior is challenging due to the isolated nature of slice recordings. To address this, we recorded macaque lateral prefrontal cortex (LPFC) neurons in vivo during a visually guided saccade task and in vitro in brain slices.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!