Annu Int Conf IEEE Eng Med Biol Soc
July 2022
A better understanding of reward signaling in the sensorimotor cortices can aid in developing Reinforcement Learning-based Brain-Computer Interfaces (RLBCI) for restoration of movement functions with fewer implants. Brain-computer interfaces (BCIs) using local field potentials (LFPs) have recently achieved performance comparable to spike-BCIs [1]. With superior stability over time, LFPs may be the preferred signal for BCIs.
View Article and Find Full Text PDFAnnu Int Conf IEEE Eng Med Biol Soc
July 2022
Neural activity in the sensorimotor cortices has been previously shown to correlate with kinematics, kinetics, and non-sensorimotor variables, such as reward. In this work, we compare the grip force offline Brain Machine Interface (BMI) prediction performance, of a simple artificial neural network (ANN), under two loss functions: the standard mean squared error (MSE) and a modified reward penalized mean squared error (RP_MSE), which penalizes for correlation between reward and grip force. Our results show that the ANN performs significantly better under the RP_MSE loss function in three brain regions: dorsal premotor cortex (PMd), primary motor cortex (M1) and the primary somatosensory cortex (S1) by approximately 6%.
View Article and Find Full Text PDFLost sensations, such as touch, could be restored by microstimulation (MiSt) along the sensory neural substrate. Such neuroprosthetic sensory information can be used as feedback from an invasive brain-machine interface (BMI) to control a robotic arm/hand, such that tactile and proprioceptive feedback from the sensorized robotic arm/hand is directly given to the BMI user. Microstimulation in the human somatosensory thalamus (Vc) has been shown to produce somatosensory perceptions.
View Article and Find Full Text PDFOur brain's ability to represent vast amounts of information, such as continuous ranges of reward spanning orders of magnitude, with limited dynamic range neurons, may be possible due to normalization. Recently our group and others have shown that the sensorimotor cortices are sensitive to reward value. Here we ask if psychological affect causes normalization of the sensorimotor cortices by modulating valence and motivational intensity.
View Article and Find Full Text PDFMirror Neurons (MNs) respond similarly when primates make or observe grasping movements. Recent work indicates that reward expectation influences rostral M1 (rM1) during manual, observational, and Brain Machine Interface (BMI) reaching movements. Previous work showed MNs are modulated by subjective value.
View Article and Find Full Text PDFReward modulation is represented in the motor cortex (M1) and could be used to implement more accurate decoding models to improve brain-computer interfaces (BCIs; Zhao et al., 2018). Analyzing trial-to-trial noise-correlations between neural units in the presence of rewarding (R) and non-rewarding (NR) stimuli adds to our understanding of cortical network dynamics.
View Article and Find Full Text PDFWe are developing an autonomously updating brain machine interface (BMI) utilizing reinforcement learning principles. One aspect of this system is a neural critic that determines reward expectations from neural activity. This critic is then used to update a BMI decoder toward an improved performance from the user's perspective.
View Article and Find Full Text PDFProcedural motor learning and memory are accompanied by changes in synaptic plasticity, neural dynamics, and synaptogenesis. Missing is information on the spatiotemporal dynamics of the molecular machinery maintaining these changes. Here we examine whether persistent increases in PKMζ, an atypical protein kinase C (PKC) isoform, store long-term memory for a reaching task in rat sensorimotor cortex that could reveal the sites of procedural memory storage.
View Article and Find Full Text PDFMotor output mostly depends on sensory input, which also can be affected by action. To further our understanding of how tactile information is processed in the primary somatosensory cortex (S1) in dynamic environments, we recorded neural responses to tactile stimulation of the hand in three awake monkeys under arm/hand passive movement and rest. We found that neurons generally responded to tactile stimulation under both conditions and were modulated by movement: with a higher baseline firing rate, a suppressed peak rate, and a smaller dynamic range during passive movement than during rest, while the area under the response curve was stable across these two states.
View Article and Find Full Text PDFMicrostimulation (MiSt) is used experimentally and clinically to activate localized populations of neural elements. However, it is difficult to predict-and subsequently control-neural responses to simultaneous current injection through multiple electrodes in an array. This is due to the unknown locations of neuronal elements in the extracellular medium that are excited by the superposition of multiple parallel current sources.
View Article and Find Full Text PDFWe will discuss some of the current issues in understanding plasticity in the sensorimotor (SM) cortices on the behavioral, neurophysiological, and synaptic levels. We will focus our paper on reaching and grasping movements in the rat. In addition, we will discuss our preliminary work utilizing inhibition of protein kinase Mζ (PKMζ), which has recently been shown necessary and sufficient for the maintenance of long-term potentiation (LTP) (Ling et al.
View Article and Find Full Text PDFSensorimotor cortex has a role in procedural learning. Previous studies suggested that this learning is subserved by long-term potentiation (LTP), which is in turn maintained by the persistently active kinase, protein kinase Mzeta (PKMzeta). Whereas the role of PKMzeta in animal models of declarative knowledge is established, its effect on procedural knowledge is not well understood.
View Article and Find Full Text PDF