Neurofeedback through the lens of reinforcement learning.

Trends Neurosci

School of Psychological Sciences, Gershon H. Gordon Faculty of Social Sciences, Tel Aviv University, Tel Aviv, Israel; Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Sagol school of Neuroscience, Tel Aviv University, Tel Aviv, Israel; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel. Electronic address:

Published: August 2022

Despite decades of experimental and clinical practice, the neuropsychological mechanisms underlying neurofeedback (NF) training remain obscure. NF is a unique form of reinforcement learning (RL) task, during which participants are provided with rewarding feedback regarding desired changes in neural patterns. However, key RL considerations - including choices during practice, prediction errors, credit-assignment problems, or the exploration-exploitation tradeoff - have infrequently been considered in the context of NF. We offer an RL-based framework for NF, describing different internal states, actions, and rewards in common NF protocols, thus fashioning new proposals for characterizing, predicting, and hastening the course of learning. In this way we hope to advance current understanding of neural regulation via NF, and ultimately to promote its effectiveness, personalization, and clinical utility.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.tins.2022.03.008DOI Listing

Publication Analysis

Top Keywords

reinforcement learning
8
neurofeedback lens
4
lens reinforcement
4
learning despite
4
despite decades
4
decades experimental
4
experimental clinical
4
clinical practice
4
practice neuropsychological
4
neuropsychological mechanisms
4

Similar Publications

Objectives: This study introduces Smart Imitator (SI), a 2-phase reinforcement learning (RL) solution enhancing personalized treatment policies in healthcare, addressing challenges from imperfect clinician data and complex environments.

Materials And Methods: Smart Imitator's first phase uses adversarial cooperative imitation learning with a novel sample selection schema to categorize clinician policies from optimal to nonoptimal. The second phase creates a parameterized reward function to guide the learning of superior treatment policies through RL.

View Article and Find Full Text PDF

Cpeb1 remodels cell type-specific translational program to promote fear extinction.

Sci Adv

January 2025

Department of Medical Genetics, School of Basic Medicine, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei 430030, China.

Protein translation is crucial for fear extinction, a process vital for adaptive behavior and mental health, yet the underlying cell-specific mechanisms remain elusive. Using a Tet-On 3G genetic approach, we achieved precise temporal control over protein translation in the infralimbic medial prefrontal cortex () during fear extinction. In addition, our results reveal that the disruption of cytoplasmic polyadenylation element binding protein 1 (Cpeb1) leads to notable alterations in cell type-specific translational programs, thereby affecting fear extinction.

View Article and Find Full Text PDF

In single cells, variably sized nanoscale chromatin structures are observed, but it is unknown whether these form a cohesive framework that regulates RNA transcription. Here, we demonstrate that the human genome is an emergent, self-assembling, reinforcement learning system. Conformationally defined heterogeneous, nanoscopic packing domains form by the interplay of transcription, nucleosome remodeling, and loop extrusion.

View Article and Find Full Text PDF

Valence and salience encoding in the central amygdala.

Elife

January 2025

Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, United States.

The central amygdala (CeA) has emerged as an important brain region for regulating both negative (fear and anxiety) and positive (reward) affective behaviors. The CeA has been proposed to encode affective information in the form of valence (whether the stimulus is good or bad) or salience (how significant is the stimulus), but the extent to which these two types of stimulus representation occur in the CeA is not known. Here, we used single cell calcium imaging in mice during appetitive and aversive conditioning and found that majority of CeA neurons (~65%) encode the valence of the unconditioned stimulus (US) with a smaller subset of cells (~15%) encoding the salience of the US.

View Article and Find Full Text PDF

Enabling Fast AI-Driven Inverse Design of a Multifunctional Nanosurface by Parallel Evolution Strategies.

Nanomaterials (Basel)

December 2024

Department of Civil, Construction, and Environmental Engineering, Iowa State University, Ames, IA 50011, USA.

Multifunctional nanosurfaces receive growing attention due to their versatile properties. Capillary force lithography (CFL) has emerged as a simple and economical method for fabricating these surfaces. In recent works, the authors proposed to leverage the evolution strategies (ES) to modify nanosurface characteristics with CFL to achieve specific functionalities such as frictional, optical, and bactericidal properties.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!