Expressivity of Neural Networks with Random Weights and Learned Biases.

Landmark universal function approximation results for neural networks with trained weights and biases provided impetus for the ubiquitous use of neural networks as learning models in Artificial Intelligence (AI) and neuroscience. Recent work has pushed the bounds of universal approximation by showing that arbitrary functions can similarly be learned by tuning smaller subsets of parameters, for example the output weights, within randomly initialized networks. Motivated by the fact that biases can be interpreted as biologically plausible mechanisms for adjusting unit outputs in neural networks, such as tonic inputs or activation thresholds, we investigate the expressivity of neural networks with random weights where only biases are optimized.

A Unified, Scalable Framework for Neural Population Decoding.

Our ability to use deep learning approaches to decipher neural activity would likely benefit from greater scale, in terms of both model size and datasets. However, the integration of many neural recordings into one unified model is challenging, as each recording contains the activity of different neurons from different individual animals. In this paper, we introduce a training framework and architecture designed to model the population dynamics of neural activity across diverse, large-scale neural recordings.

Preserved neural dynamics across animals performing similar behaviour.

Animals of the same species exhibit similar behaviours that are advantageously adapted to their body and environment. These behaviours are shaped at the species level by selection pressures over evolutionary timescales. Yet, it remains unclear how these common behavioural adaptations emerge from the idiosyncratic neural circuitry of each individual.

A spinal cord neuroprosthesis for locomotor deficits due to Parkinson's disease.

People with late-stage Parkinson's disease (PD) often suffer from debilitating locomotor deficits that are resistant to currently available therapies. To alleviate these deficits, we developed a neuroprosthesis operating in closed loop that targets the dorsal root entry zones innervating lumbosacral segments to reproduce the natural spatiotemporal activation of the lumbosacral spinal cord during walking. We first developed this neuroprosthesis in a non-human primate model that replicates locomotor deficits due to PD.

Nonlinear manifolds underlie neural population activity during behaviour.

There is rich variety in the activity of single neurons recorded during behaviour. Yet, these diverse single neuron responses can be well described by relatively few patterns of neural co-modulation. The study of such low-dimensional structure of neural population activity has provided important insights into how the brain generates behaviour.

motor learning creates structure in neural activity space that shapes adaptation.

Animals can quickly adapt learned movements in response to external perturbations. Motor adaptation is likely influenced by an animal's existing movement repertoire, but the nature of this influence is unclear. Long-term learning causes lasting changes in neural connectivity which determine the activity patterns that can be produced.

Motor cortex latent dynamics encode spatial and temporal arm movement parameters independently.

The fluid movement of an arm requires multiple spatiotemporal parameters to be set independently. Recent studies have argued that arm movements are generated by the collective dynamics of neurons in motor cortex. An untested prediction of this hypothesis is that independent parameters of movement must map to independent components of the neural dynamics.

Small, correlated changes in synaptic connectivity may facilitate rapid motor learning.

Animals rapidly adapt their movements to external perturbations, a process paralleled by changes in neural activity in the motor cortex. Experimental studies suggest that these changes originate from altered inputs (H) rather than from changes in local connectivity (H), as neural covariance is largely preserved during adaptation. Since measuring synaptic changes in vivo remains very challenging, we used a modular recurrent neural network to qualitatively test this interpretation.

Local field potentials reflect cortical population dynamics in a region-specific and frequency-dependent manner.

The spiking activity of populations of cortical neurons is well described by the dynamics of a small number of population-wide covariance patterns, whose activation we refer to as 'latent dynamics'. These latent dynamics are largely driven by the same correlated synaptic currents across the circuit that determine the generation of local field potentials (LFPs). Yet, the relationship between latent dynamics and LFPs remains largely unexplored.

Epidural electrical stimulation of the cervical dorsal roots restores voluntary upper limb control in paralyzed monkeys.

Regaining arm control is a top priority for people with paralysis. Unfortunately, the complexity of the neural mechanisms underlying arm control has limited the effectiveness of neurotechnology approaches. Here, we exploited the neural function of surviving spinal circuits to restore voluntary arm and hand control in three monkeys with spinal cord injury, using spinal cord stimulation.

Rethinking brain-wide interactions through multi-region 'network of networks' models.

The neural control of behavior is distributed across many functionally and anatomically distinct brain regions even in small nervous systems. While classical neuroscience models treated these regions as a set of hierarchically isolated nodes, the brain comprises a recurrently interconnected network in which each region is intimately modulated by many others. Uncovering these interactions is now possible through experimental techniques that access large neural populations from many brain regions simultaneously.

Machine Learning for Neural Decoding.

Despite rapid advances in machine learning tools, the majority of neural decoding approaches still use traditional methods. Modern machine learning tools, which are versatile and easy to use, have the potential to significantly improve decoding performance. This tutorial describes how to effectively apply these algorithms for typical decoding problems.

Long-term stability of cortical population dynamics underlying consistent behavior.

Animals readily execute learned behaviors in a consistent manner over long periods of time, and yet no equally stable neural correlate has been demonstrated. How does the cortex achieve this stable control? Using the sensorimotor system as a model of cortical processing, we investigated the hypothesis that the dynamics of neural latent activity, which captures the dominant co-variation patterns within the neural population, must be preserved across time. We recorded from populations of neurons in premotor, primary motor and somatosensory cortices as monkeys performed a reaching task, for up to 2 years.

A Neural Population Mechanism for Rapid Learning.

Long-term learning of language, mathematics, and motor skills likely requires cortical plasticity, but behavior often requires much faster changes, sometimes even after single errors. Here, we propose one neural mechanism to rapidly develop new motor output without altering the functional connectivity within or between cortical areas. We tested cortico-cortical models relating the activity of hundreds of neurons in the premotor (PMd) and primary motor (M1) cortices throughout adaptation to reaching movement perturbations.

Cortical population activity within a preserved neural manifold underlies multiple motor behaviors.

Populations of cortical neurons flexibly perform different functions; for the primary motor cortex (M1) this means a rich repertoire of motor behaviors. We investigate the flexibility of M1 movement control by analyzing neural population activity during a variety of skilled wrist and reach-to-grasp tasks. We compare across tasks the neural modes that capture dominant neural covariance patterns during each task.

Linear-nonlinear-time-warp-poisson models of neural activity.

Prominent models of spike trains assume only one source of variability - stochastic (Poisson) spiking - when stimuli and behavior are fixed. However, spike trains may also reflect variability due to internal processes such as planning. For example, we can plan a movement at one point in time and execute it at some arbitrary later time.

Population coding of conditional probability distributions in dorsal premotor cortex.

Our bodies and the environment constrain our movements. For example, when our arm is fully outstretched, we cannot extend it further. More generally, the distribution of possible movements is conditioned on the state of our bodies in the environment, which is constantly changing.

A cryptography-based approach for movement decoding.

Brain decoders use neural recordings to infer the activity or intent of a user. To train a decoder, one generally needs to infer the measured variables of interest (covariates) from simultaneously measured neural activity. However, there are cases for which obtaining supervised data is difficult or impossible.

Neural Manifolds for the Control of Movement.

The analysis of neural dynamics in several brain cortices has consistently uncovered low-dimensional manifolds that capture a significant fraction of neural variability. These neural manifolds are spanned by specific patterns of correlated neural activity, the "neural modes." We discuss a model for neural control of movement in which the time-dependent activation of these neural modes is the generator of motor behavior.

Altered tuning in primary motor cortex does not account for behavioral adaptation during force field learning.

Although primary motor cortex (M1) is intimately involved in the dynamics of limb movement, its inputs may be more closely related to higher-order aspects of movement and multi-modal sensory feedback. Motor learning is thought to result from the adaption of internal models that compute transformations between these representations. While the psychophysics of motor learning has been studied in many experiments, the particular role of M1 in the process remains the subject of debate.

Representation of Stimulus Speed and Direction in Vibrissal-Sensitive Regions of the Trigeminal Nuclei: A Comparison of Single Unit and Population Responses.

The rat vibrissal (whisker) system is one of the oldest and most important models for the study of active tactile sensing and sensorimotor integration. It is well established that primary sensory neurons in the trigeminal ganglion respond to deflections of one and only one whisker, and that these neurons are strongly tuned for both the speed and direction of individual whisker deflections. During active whisking behavior, however, multiple whiskers will be deflected simultaneously.

Network-timing-dependent plasticity.

Bursts of activity in networks of neurons are thought to convey salient information and drive synaptic plasticity. Here we report that network bursts also exert a profound effect on Spike-Timing-Dependent Plasticity (STDP). In acute slices of juvenile rat somatosensory cortex we paired a network burst, which alone induced long-term depression (LTD), with STDP-induced long-term potentiation (LTP) and LTD.