One-core neuron deep learning for time series prediction.

Natl Sci Rev

Key Laboratory of Systems Health Science of Zhejiang Province, School of Life Science, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Chinese Academy of Sciences, Hangzhou 310024, China.

Published: February 2025

The enormous computational requirements and unsustainable resource consumption associated with massive parameters of large language models and large vision models have given rise to challenging issues. Here, we propose an interpretable 'small model' framework characterized by only a single core-neuron, i.e. the one-core-neuron system (OCNS), to significantly reduce the number of parameters while maintaining performance comparable to the existing 'large models' in time-series forecasting. With multiple delay feedback designed in this single neuron, our OCNS is able to convert one input feature vector/state into one-dimensional time-series/sequence, which is theoretically ensured to fully represent the states of the observed dynamical system. Leveraging the spatiotemporal information transformation, the OCNS shows excellent and robust performance in forecasting tasks, in particular for short-term high-dimensional systems. The results collectively demonstrate that the proposed OCNS with a single core neuron offers insights into constructing deep learning frameworks with a small model, presenting substantial potential as a new way for achieving efficient deep learning.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11737406PMC
http://dx.doi.org/10.1093/nsr/nwae441DOI Listing

Publication Analysis

Top Keywords

deep learning
12
one-core neuron
4
neuron deep
4
learning time
4
time series
4
series prediction
4
prediction enormous
4
enormous computational
4
computational requirements
4
requirements unsustainable
4

Similar Publications

Deep learning has emerged as a powerful tool in medical imaging, particularly for corneal topographic map classification. However, the scarcity of labeled data poses a significant challenge to achieving robust performance. This study investigates the impact of various data augmentation strategies on enhancing the performance of a customized convolutional neural network model for corneal topographic map classification.

View Article and Find Full Text PDF

Economic losses in cattle farms are frequently associated with failed pregnancies. Some studies found that the transcriptomic profiles of blood and endometrial tissues in cattle with varying pregnancy outcomes display discrepancies even before artificial insemination (AI) or embryo transfer (ET). In the study, 330 samples from seven distinct sources and two tissue types were integrated and divided into two groups based on the ability to establish and maintain pregnancy after AI or ET: P (pregnant) and NP (nonpregnant).

View Article and Find Full Text PDF

Objectives: This study aimed to develop an automated method for generating clearer, well-aligned panoramic views by creating an optimized three-dimensional (3D) reconstruction zone centered on the teeth. The approach focused on achieving high contrast and clarity in key dental features, including tooth roots, morphology, and periapical lesions, by applying a 3D U-Net deep learning model to generate an arch surface and align the panoramic view.

Methods: This retrospective study analyzed anonymized cone-beam CT (CBCT) scans from 312 patients (mean age 40 years; range 10-78; 41.

View Article and Find Full Text PDF

Bruises can affect the appearance and nutritional value of apples and cause economic losses. Therefore, the accurate detection of bruise levels and bruise time of apples is crucial. In this paper, we proposed a method that combines a self-designed multispectral imaging system with deep learning to accurately detect the level and time of bruising on apples.

View Article and Find Full Text PDF

The image retrieval is the process of retrieving the relevant images to the query image with minimal searching time in internet. The problem of the conventional Content-Based Image Retrieval (CBIR) system is that they produce retrieval results for either colour images or grey scale images alone. Moreover, the CBIR system is more complex which consumes more time period for producing the significant retrieval results.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!