Despite decades of experimental and clinical practice, the neuropsychological mechanisms underlying neurofeedback (NF) training remain obscure. NF is a unique form of reinforcement learning (RL) task, during which participants are provided with rewarding feedback regarding desired changes in neural patterns. However, key RL considerations - including choices during practice, prediction errors, credit-assignment problems, or the exploration-exploitation tradeoff - have infrequently been considered in the context of NF. We offer an RL-based framework for NF, describing different internal states, actions, and rewards in common NF protocols, thus fashioning new proposals for characterizing, predicting, and hastening the course of learning. In this way we hope to advance current understanding of neural regulation via NF, and ultimately to promote its effectiveness, personalization, and clinical utility.
Download full-text PDF |
Source |
---|---|
http://dx.doi.org/10.1016/j.tins.2022.03.008 | DOI Listing |
J Am Med Inform Assoc
January 2025
Institute of Data Science, National University of Singapore, 117602, Singapore.
Objectives: This study introduces Smart Imitator (SI), a 2-phase reinforcement learning (RL) solution enhancing personalized treatment policies in healthcare, addressing challenges from imperfect clinician data and complex environments.
Materials And Methods: Smart Imitator's first phase uses adversarial cooperative imitation learning with a novel sample selection schema to categorize clinician policies from optimal to nonoptimal. The second phase creates a parameterized reward function to guide the learning of superior treatment policies through RL.
Sci Adv
January 2025
Department of Medical Genetics, School of Basic Medicine, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei 430030, China.
Protein translation is crucial for fear extinction, a process vital for adaptive behavior and mental health, yet the underlying cell-specific mechanisms remain elusive. Using a Tet-On 3G genetic approach, we achieved precise temporal control over protein translation in the infralimbic medial prefrontal cortex () during fear extinction. In addition, our results reveal that the disruption of cytoplasmic polyadenylation element binding protein 1 (Cpeb1) leads to notable alterations in cell type-specific translational programs, thereby affecting fear extinction.
View Article and Find Full Text PDFSci Adv
January 2025
Center for Physical Genomics and Engineering, Northwestern University, Evanston, IL 60208, USA.
In single cells, variably sized nanoscale chromatin structures are observed, but it is unknown whether these form a cohesive framework that regulates RNA transcription. Here, we demonstrate that the human genome is an emergent, self-assembling, reinforcement learning system. Conformationally defined heterogeneous, nanoscopic packing domains form by the interplay of transcription, nucleosome remodeling, and loop extrusion.
View Article and Find Full Text PDFElife
January 2025
Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, United States.
The central amygdala (CeA) has emerged as an important brain region for regulating both negative (fear and anxiety) and positive (reward) affective behaviors. The CeA has been proposed to encode affective information in the form of valence (whether the stimulus is good or bad) or salience (how significant is the stimulus), but the extent to which these two types of stimulus representation occur in the CeA is not known. Here, we used single cell calcium imaging in mice during appetitive and aversive conditioning and found that majority of CeA neurons (~65%) encode the valence of the unconditioned stimulus (US) with a smaller subset of cells (~15%) encoding the salience of the US.
View Article and Find Full Text PDFNanomaterials (Basel)
December 2024
Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, IA 50011, USA.
Multifunctional nanosurfaces receive growing attention due to their versatile properties. Capillary force lithography (CFL) has emerged as a simple and economical method for fabricating these surfaces. In recent works, the authors proposed to leverage the evolution strategies (ES) to modify nanosurface characteristics with CFL to achieve specific functionalities such as frictional, optical, and bactericidal properties.
View Article and Find Full Text PDFEnter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!