Evaluating the effectiveness of self-attention mechanism in tuberculosis time series forecasting.

BMC Infect Dis

Key Laboratory of Molecular Epidemiology of Hunan Province, School of Medicine, Hunan Normal University, Changsha, Hunan, 410013, China.

Published: December 2024

AI Article Synopsis

  • The study focuses on predicting tuberculosis cases to enhance public health resource allocation, using a self-attention mechanism for improved accuracy.
  • Monthly case data from 2010 to 2021 in Changde City was used to compare the performance of three models: self-attention, LSTM, and ARIMA, evaluated on RMSE, MAE, and MAPE metrics.
  • Results showed the self-attention model significantly outperformed the others, demonstrating its effectiveness in accurately forecasting tuberculosis cases, which can aid health departments in better resource management.

Article Abstract

Background: With the increasing impact of tuberculosis on public health, accurately predicting future tuberculosis cases is crucial for optimizing of health resources and medical service allocation. This study applies a self-attention mechanism to predict the number of tuberculosis cases, aiming to evaluate its effectiveness in forecasting.

Methods: Monthly tuberculosis case data from Changde City between 2010 and 2021 were used to construct a self-attention model, a long short-term memory (LSTM) model, and an autoregressive integrated moving average (ARIMA) model. The performance of these models was evaluated using three metrics: root mean square error (RMSE), mean absolute error (MAE), and mean absolute percentage error (MAPE).

Results: The self-attention model outperformed the other models in terms of prediction accuracy. On the test set, the RMSE of the self-attention model was approximately 7.41% lower than that of the LSTM model, MAE was reduced by about 10.99%, and MAPE was reduced by approximately 9.87%. Compared to the ARIMA model, RMSE was reduced by about 28.86%, MAE by about 32.22%, and MAPE by approximately 29.89%.

Conclusion: The self-attention model can effectively improve the prediction accuracy of tuberculosis cases, providing guidance for health departments optimizing of health resources and medical service allocation.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11613505PMC
http://dx.doi.org/10.1186/s12879-024-10183-9DOI Listing

Publication Analysis

Top Keywords

self-attention model
16
tuberculosis cases
12
self-attention mechanism
8
optimizing health
8
health resources
8
resources medical
8
medical service
8
service allocation
8
model
8
lstm model
8

Similar Publications

Background: With the global population aging and advancements in the medical system, long-term care in healthcare institutions and home settings has become essential for older adults with disabilities. However, the diverse and scattered care requirements of these individuals make developing effective long-term care plans heavily reliant on professional nursing staff, and even experienced caregivers may make mistakes or face confusion during the care plan development process. Consequently, there is a rigid demand for intelligent systems that can recommend comprehensive long-term care plans for older adults with disabilities who have stable clinical conditions.

View Article and Find Full Text PDF

Attention mechanisms such as the Convolutional Block Attention Module (CBAM) can help emphasize and refine the most relevant feature maps such as color, texture, spots, and wrinkle variations for the avocado ripeness classification. However, the CBAM lacks global context awareness, which may prevent it from capturing long-range dependencies or global patterns such as relationships between distant regions in the image. Further, more complex neural networks can improve model performance but at the cost of increasing the number of layers and train parameters, which may not be suitable for resource constrained devices.

View Article and Find Full Text PDF

ShadowGAN-Former: Reweighting self-attention based on mask for shadow removal.

Neural Netw

January 2025

Department of Mechanical Engineering, Politecnico di Milano, Milan, Italy.

Shadow removal remains a challenging visual task aimed at restoring the original brightness of shadow regions in images. Many existing methods overlook the implicit clues within non-shadow regions, leading to inconsistencies in the color, texture, and illumination of the reconstructed shadow-free images. To address these issues, we propose an efficient hybrid model of Transformer and Generative Adversarial Network (GAN), named ShadowGAN-Former, which utilizes information from non-shadow regions to assist in shadow removal.

View Article and Find Full Text PDF

Motor Imagery (MI) electroencephalographic (EEG) signal classification is a pioneer research branch essential for mobility rehabilitation. This paper proposes an end-to-end hybrid deep network "Spatio Temporal Inception Transformer Network (STIT-Net)" model for MI classification. Discrete Wavelet Transform (DWT) is used to derive the alpha (8-13) Hz and beta (13-30) Hz EEG sub bands which are dominant during motor tasks to enhance the performance of the proposed work.

View Article and Find Full Text PDF

Passive Fourier transform infrared spectroscopy, used to detect chemical pollutants in the air, works with extremely weak signals with complex and varying background interference. This significantly challenges gas identification in terms of precision. Consequently, limited research progress has been made in this area.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!