Spiking neural networks (SNNs) mimic their biological counterparts more closely than their predecessors and are considered the third generation of artificial neural networks. It has been proven that networks of spiking neurons have a higher computational capacity and lower power requirements than sigmoidal neural networks. This article introduces a new type of SNN that draws inspiration and incorporates concepts from neuronal assemblies in the human brain. The proposed network, termed as class-dependent neuronal activation-based SNN (CDNA-SNN), assigns each neuron learnable values known as CDNAs which indicate the neuron's average relative spiking activity in response to samples from different classes. A new learning algorithm that categorizes the neurons into different class assemblies based on their CDNAs is also presented. These neuronal assemblies are trained via a novel training method based on spike-timing-dependent plasticity (STDP) to have high activity for their associated class and low firing rate for other classes. Also, using CDNAs, a new type of STDP that controls the amount of plasticity based on the assemblies of pre-and postsynaptic neurons is proposed. The performance of CDNA-SNN is evaluated on five datasets from the University of California, Irvine (UCI) machine learning repository, as well as Modified National Institute of Standards and Technology (MNIST) and Fashion MNIST, using nested cross-validation (N-CV) for hyperparameter optimization. Our results show that CDNA-SNN significantly outperforms synaptic weight association training (SWAT) ( p 0.0005) and SpikeProp ( p 0.05) on 3/5 and self-regulating evolving spiking neural (SRESN) ( p 0.05) on 2/5 UCI datasets while using the significantly lower number of trainable parameters. Furthermore, compared to other supervised, fully connected SNNs, the proposed SNN reaches the best performance for Fashion MNIST and comparable performance for MNIST and neuromorphic-MNIST (N-MNIST), also utilizing much less (1%-35%) parameters.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TNNLS.2024.3353571DOI Listing

Publication Analysis

Top Keywords

spiking neural
12
neuronal assemblies
12
neural networks
12
fashion mnist
8
neural
5
assemblies
5
cdna-snn
4
cdna-snn spiking
4
neural network
4
network pattern
4

Similar Publications

Resistive memory-based zero-shot liquid state machine for multimodal event data learning.

Nat Comput Sci

January 2025

Key Lab of Fabrication Technologies for Integrated Circuits and Key Laboratory of Microelectronic Devices and Integrated Technology, Institute of Microelectronics of the Chinese Academy of Sciences, Beijing, China.

The human brain is a complex spiking neural network (SNN) capable of learning multimodal signals in a zero-shot manner by generalizing existing knowledge. Remarkably, it maintains minimal power consumption through event-based signal propagation. However, replicating the human brain in neuromorphic hardware presents both hardware and software challenges.

View Article and Find Full Text PDF

Individualized Spectral Features in First-episode and Drug-naïve Major Depressive Disorder: Insights from Periodic and Aperiodic EEG Analysis.

Biol Psychiatry Cogn Neurosci Neuroimaging

January 2025

School of Biomedical Sciences and Engineering, South China University of Technology, Guangzhou 511442, China; National Engineering Research Center for Tissue Restoration and Reconstruction, South China University of Technology, Guangzhou 510006, China; Guangdong Province Key Laboratory of Biomedical Engineering, South China University of Technology, Guangzhou 510006, China; Department of Nuclear Medicine and Radiology, Institute of Development, Aging and Cancer, Tohoku University, Sendai 980-8575, Japan. Electronic address:

Background: The detection of abnormal brain activity plays an important role in the early diagnosis and treatment of major depressive disorder (MDD). Recent studies have shown that the decomposition of the electroencephalography (EEG) spectrum into periodic and aperiodic components is useful for identifying the drivers of electrophysiologic abnormalities and avoiding individual differences.

Methods: This study aimed to elucidate the pathologic changes in individualized periodic and aperiodic activities and their relationships with the symptoms of MDD.

View Article and Find Full Text PDF

Neurocan regulates axon initial segment organization and neuronal activity.

Matrix Biol

January 2025

German Center for Neurodegenerative Diseases (DZNE), Helmholtz Association of German Research Centers, Magdeburg, Germany; Center for Behavioral Brain Sciences (CBBS), Magdeburg, Germany; Medical Faculty, Otto-von-Guericke University, Magdeburg, Germany. Electronic address:

The neural extracellular matrix (ECM) accumulates in the form of perineuronal nets (PNNs), particularly around fast-spiking GABAergic interneurons in the cortex and hippocampus, but also around synapses and in association with the axon initial segments (AIS) and nodes of Ranvier. Increasing evidence highlights the role of Neurocan (Ncan), a brain-specific component of ECM, in the pathophysiology of neuropsychiatric disorders like bipolar disorder and schizophrenia. Ncan localizes at PNNs, perisynaptically, and at the nodes of Ranvier and the AIS, highlighting its potential role in regulating axonal excitability.

View Article and Find Full Text PDF

Hypotheses of pathophysiological mechanisms in epileptic encephalopathies: A review.

Brain Dev

January 2025

Department of Pediatric Neurology, Okayama University Hospital and Faculty of Medicine, Dentistry and Pharmaceutical Sciences, Okayama University, Okayama, Japan.

Introduction: Epileptic encephalopathy (EE) is a serious clinical issue that manifests as part of developmental and epileptic encephalopathy (DEE), particularly in childhood epilepsy. In EE, neurocognitive functions and behavior are impaired by intense epileptiform electroencephalogram (EEG) activity. Hypotheses of pathophysiological mechanisms behind EE are reviewed to contribute to an effective solution for EE.

View Article and Find Full Text PDF

Toward a Free-Response Paradigm of Decision-Making in Spiking Neural Networks.

Neural Comput

January 2025

Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, 200437, China

Spiking neural networks (SNNs) have attracted significant interest in the development of brain-inspired computing systems due to their energy efficiency and similarities to biological information processing. In contrast to continuous-valued artificial neural networks, which produce results in a single step, SNNs require multiple steps during inference to achieve a desired accuracy level, resulting in a burden in real-time response and energy efficiency. Inspired by the tradeoff between speed and accuracy in human and animal decision-making processes, which exhibit correlations among reaction times, task complexity, and decision confidence, an inquiry emerges regarding how an SNN model can benefit by implementing these attributes.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!