Memristor and activation function are two important nonlinear factors of the memristive Hopfield neural network. The effects of different memristors on the dynamics of Hopfield neural networks have been studied by many researchers. However, less attention has been paid to the activation function. In this paper, we present a heterogeneous memristive Hopfield neural network with neurons using different activation functions. The activation functions include fixed activation functions and an adaptive activation function, where the adaptive activation function is based on a memristor. The theoretical and experimental study of the neural network's dynamics has been conducted using phase portraits, bifurcation diagrams, and Lyapunov exponents spectras. Numerical results show that complex dynamical behaviors such as multi-scroll chaos, transient chaos, state jumps and multi-type coexisting attractors can be observed in the heterogeneous memristive Hopfield neural network. In addition, the hardware implementation of memristive Hopfield neural network with adaptive activation function is designed and verified. The experimental results are in good agreement with those obtained using numerical simulations.
Download full-text PDF |
Source |
|---|---|
| http://dx.doi.org/10.1016/j.neunet.2024.106408 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Hopfield neural networks (HNNs) promise broad applications in areas such as combinatorial optimization, memory storage, and pattern recognition. Among various implementations, optical HNNs are particularly interesting because they can take advantage of fast optical matrix-vector multiplications. Yet their studies so far have mostly been on the theoretical side, and the effects of optical imperfections and robustness against memory errors remain to be quantified.
View Article and Find Full Text PDFInvestigation on the regular and chaotic dynamics of a ring network of five inertial Hopfield neural network: theoretical, analog and microcontroller simulation.
Cogn Neurodyn
December 2024
Department of Electronics and Communication Engineering, Vemu Institute of Technology, Chittoor, India.
The studies conducted in this contribution are based on the analysis of the dynamics of a homogeneous network of five inertial neurons of the Hopfield type to which a unidirectional ring coupling topology is applied. The coupling is achieved by perturbing the next neuron's amplitude with a signal proportional to the previous one. The system consists of ten coupled ODEs, and the investigations carried out have allowed us to highlight several unusual and rarely related dynamics, hence the importance of emphasizing them.
View Article and Find Full Text PDFPlane coexistence behaviors for Hopfield neural network with two-memristor-interconnected neurons.
Neural Netw
December 2024
Wang Zheng School of Microelectronics, Changzhou University, Changzhou, 213159, PR China. Electronic address:
Memristors are commonly used as the connecting parts of neurons in brain-like neural networks. The memristors, unlike the existing literature, possess the capability to function as both self-connected synaptic weights and interconnected synaptic weights, thereby enabling the generation of intricate initials-regulated plane coexistence behaviors. To demonstrate this dynamical effect, a Hopfield neural network with two-memristor-interconnected neurons (TMIN-HNN) is proposed.
View Article and Find Full Text PDFA self-learning magnetic Hopfield neural network with intrinsic gradient descent adaption.
Proc Natl Acad Sci U S A
December 2024
State Key Laboratory of Surface Physics and Institute for Nanoelectronic Devices and Quantum Computing, Fudan University, Shanghai 200433, China.
Physical neural networks (PNN) using physical materials and devices to mimic synapses and neurons offer an energy-efficient way to implement artificial neural networks. Yet, training PNN is difficult and heavily relies on external computing resources. An emerging concept to solve this issue is called physical self-learning that uses intrinsic physical parameters as trainable weights.
View Article and Find Full Text PDFDeterministic Versus Nondeterministic Optimization Algorithms for the Restricted Boltzmann Machine.
J Comput Cogn Eng
November 2024
Department of Computer Science, Utah Valley University, USA.
A restricted Boltzmann machine is a fully connected shallow neural network. It can be used to solve many challenging optimization problems. The Boltzmann machines are usually considered probability models.
View Article and Find Full Text PDFWant AI Summaries of new PubMed Abstracts delivered to your In-box?
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!