Neuronal diversity can improve machine learning for physics and beyond.

Diversity conveys advantages in nature, yet homogeneous neurons typically comprise the layers of artificial neural networks. Here we construct neural networks from neurons that learn their own activation functions, quickly diversify, and subsequently outperform their homogeneous counterparts on image classification and nonlinear regression tasks. Sub-networks instantiate the neurons, which meta-learn especially efficient sets of nonlinear responses.

Physics-enhanced neural networks learn order and chaos.

Artificial neural networks are universal function approximators. They can forecast dynamics, but they may need impractically many neurons to do so, especially if the dynamics is chaotic. We use neural networks that incorporate Hamiltonian dynamics to efficiently learn phase space orbits even as nonlinear systems transition from order to chaos.

Nonlinear dynamics based machine learning: Utilizing dynamics-based flexibility of nonlinear circuits to implement different functions.

The core element of machine learning is a flexible, universal function approximator that can be trained and fit into the data. One of the main challenges in modern machine learning is to understand the role of nonlinearity and complexity in these universal function approximators. In this research, we focus on nonlinear complex systems, and show their capability in representation and learning of different functions.

Chaotic attractor hopping yields logic operations.

Certain nonlinear systems can switch between dynamical attractors occupying different regions of phase space, under variation of parameters or initial states. In this work we exploit this feature to obtain reliable logic operations. With logic output 0/1 mapped to dynamical attractors bounded in distinct regions of phase space, and logic inputs encoded by a very small bias parameter, we explicitly demonstrate that the system hops consistently in response to an external input stream, operating effectively as a reliable logic gate.

Detecting and characterizing high-frequency oscillations in epilepsy: a case study of big data analysis.

We develop a framework to uncover and analyse dynamical anomalies from massive, nonlinear and non-stationary time series data. The framework consists of three steps: preprocessing of massive datasets to eliminate erroneous data segments, application of the empirical mode decomposition and Hilbert transform paradigm to obtain the fundamental components embedded in the time series at distinct time scales, and statistical/scaling analysis of the components. As a case study, we apply our framework to detecting and characterizing high-frequency oscillations (HFOs) from a big database of rat electroencephalogram recordings.

Nonlinear dynamics as an engine of computation.

Control of chaos teaches that control theory can tame the complex, random-like behaviour of chaotic systems. This alliance between control methods and physics-cybernetical physics-opens the door to many applications, including dynamics-based computing. In this article, we introduce nonlinear dynamics and its rich, sometimes chaotic behaviour as an engine of computation.

Superlinearly scalable noise robustness of redundant coupled dynamical systems.

We illustrate through theory and numerical simulations that redundant coupled dynamical systems can be extremely robust against local noise in comparison to uncoupled dynamical systems evolving in the same noisy environment. Previous studies have shown that the noise robustness of redundant coupled dynamical systems is linearly scalable and deviations due to noise can be minimized by increasing the number of coupled units. Here, we demonstrate that the noise robustness can actually be scaled superlinearly if some conditions are met and very high noise robustness can be realized with very few coupled units.

Exploiting chaos for applications.

We discuss how understanding the nature of chaotic dynamics allows us to control these systems. A controlled chaotic system can then serve as a versatile pattern generator that can be used for a range of application. Specifically, we will discuss the application of controlled chaos to the design of novel computational paradigms.

Nonlinear dynamics based digital logic and circuits.

We discuss the role and importance of dynamics in the brain and biological neural networks and argue that dynamics is one of the main missing elements in conventional Boolean logic and circuits. We summarize a simple dynamics based computing method, and categorize different techniques that we have introduced to realize logic, functionality, and programmability. We discuss the role and importance of coupled dynamics in networks of biological excitable cells, and then review our simple coupled dynamics based method for computing.

Strange nonchaotic stars.

The unprecedented light curves of the Kepler space telescope document how the brightness of some stars pulsates at primary and secondary frequencies whose ratios are near the golden mean, the most irrational number. A nonlinear dynamical system driven by an irrational ratio of frequencies generically exhibits a strange but nonchaotic attractor. For Kepler's "golden" stars, we present evidence of the first observation of strange nonchaotic dynamics in nature outside the laboratory.

Noise tolerant spatiotemporal chaos computing.

We introduce and design a noise tolerant chaos computing system based on a coupled map lattice (CML) and the noise reduction capabilities inherent in coupled dynamical systems. The resulting spatiotemporal chaos computing system is more robust to noise than a single map chaos computing system. In this CML based approach to computing, under the coupled dynamics, the local noise from different nodes of the lattice diffuses across the lattice, and it attenuates each other's effects, resulting in a system with less noise content and a more robust chaos computing architecture.

Phase shift in the 24-hour rhythm of hippocampal EEG spiking activity in a rat model of temporal lobe epilepsy.

For over a century epileptic seizures have been known to cluster at specific times of the day. Recent studies have suggested that the circadian regulatory system may become permanently altered in epilepsy, but little is known about how this affects neural activity and the daily pattern of seizures. To investigate, we tracked long-term changes in the rate of spontaneous hippocampal EEG spikes (SPKs) in a rat model of temporal lobe epilepsy.

Logical stochastic resonance with correlated internal and external noises in a synthetic biological logic block.

Following the advent of synthetic biology, several gene networks have been engineered to emulate digital devices, with the ability to program cells for different applications. In this work, we adapt the concept of logical stochastic resonance to a synthetic gene network derived from a bacteriophage λ. The intriguing results of this study show that it is possible to build a biological logic block that can emulate or switch from the AND to the OR gate functionalities through externally tuning the system parameters.

Unstable periodic orbits and noise in chaos computing.

Different methods to utilize the rich library of patterns and behaviors of a chaotic system have been proposed for doing computation or communication. Since a chaotic system is intrinsically unstable and its nearby orbits diverge exponentially from each other, special attention needs to be paid to the robustness against noise of chaos-based approaches to computation. In this paper unstable periodic orbits, which form the skeleton of any chaotic system, are employed to build a model for the chaotic system to measure the sensitivity of each orbit to noise, and to select the orbits whose symbolic representations are relatively robust against the existence of noise.

Chaos computing in terms of periodic orbits.

The complex dynamics of chaotic systems can perform computations. The parameters and/or the initial conditions of a dynamical system are the data inputs and the resulting system state is the output of the computation. By controlling how inputs are mapped to outputs, a specific function can be performed.

Stochastic amplification of calcium-activated potassium currents in Ca2+ microdomains.

Small conductance (SK) calcium-activated potassium channels are found in many tissues throughout the body and open in response to elevations in intracellular calcium. In hippocampal neurons, SK channels are spatially co-localized with L-Type calcium channels. Due to the restriction of calcium transients into microdomains, only a limited number of L-Type Ca(2+) channels can activate SK and, thus, stochastic gating becomes relevant.

Chaogates: morphing logic gates that exploit dynamical patterns.

Chaotic systems can yield a wide variety of patterns. Here we use this feature to generate all possible fundamental logic gate functions. This forms the basis of the design of a dynamical computing device, a chaogate, that can be rapidly morphed to become any desired logic gate.

Introduction to focus issue: intrinsic and designed computation: information processing in dynamical systems--beyond the digital hegemony.

How dynamical systems store and process information is a fundamental question that touches a remarkably wide set of contemporary issues: from the breakdown of Moore's scaling laws--that predicted the inexorable improvement in digital circuitry--to basic philosophical problems of pattern in the natural world. It is a question that also returns one to the earliest days of the foundations of dynamical systems theory, probability theory, mathematical logic, communication theory, and theoretical computer science. We introduce the broad and rather eclectic set of articles in this Focus Issue that highlights a range of current challenges in computing and dynamical systems.

Support vector machines for seizure detection in an animal model of chronic epilepsy.

We compare the performance of three support vector machine (SVM) types: weighted SVM, one-class SVM and support vector data description (SVDD) for the application of seizure detection in an animal model of chronic epilepsy. Large EEG datasets (273 h and 91 h respectively, with a sampling rate of 1 kHz) from two groups of rats with chronic epilepsy were used in this study. For each of these EEG datasets, we extracted three energy-based seizure detection features: mean energy, mean curve length and wavelet energy.

Granger causality relationships between local field potentials in an animal model of temporal lobe epilepsy.

An understanding of the in vivo spatial emergence of abnormal brain activity during spontaneous seizure onset is critical to future early seizure detection and closed-loop seizure prevention therapies. In this study, we use Granger causality (GC) to determine the strength and direction of relationships between local field potentials (LFPs) recorded from bilateral microelectrode arrays in an intermittent spontaneous seizure model of chronic temporal lobe epilepsy before, during, and after Racine grade partial onset generalized seizures. Our results indicate distinct patterns of directional GC relationships within the hippocampus, specifically from the CA1 subfield to the dentate gyrus, prior to and during seizure onset.

Effects of phase on homeostatic spike rates.

Recent experimental results by Talathi et al. (Neurosci Lett 455:145-149, 2009) showed a divergence in the spike rates of two types of population spike events, representing the putative activity of the excitatory and inhibitory neurons in the CA1 area of an animal model for temporal lobe epilepsy. The divergence in the spike rate was accompanied by a shift in the phase of oscillations between these spike rates leading to a spontaneous epileptic seizure.

A noise-assisted reprogrammable nanomechanical logic gate.

We present a nanomechanical device, operating as a reprogrammable logic gate, and performing fundamental logic functions such as AND/OR and NAND/NOR. The logic function can be programmed (e.g.