Attention-Based Deep Recurrent Neural Network to Forecast the Temperature Behavior of an Electric Arc Furnace Side-Wall.

Sensors (Basel)

Departamento de Ingeniería Eléctrica y Electrónica, Universidad Nacional de Colombia, Cra 45 No. 26-85, Bogotá 111321, Colombia.

Published: February 2022

Structural health monitoring (SHM) in an electric arc furnace is performed in several ways. It depends on the kind of element or variable to monitor. For instance, the lining of these furnaces is made of refractory materials that can be worn out over time. Therefore, monitoring the temperatures on the walls and the cooling elements of the furnace is essential for correct structural monitoring. In this work, a multivariate time series temperature prediction was performed through a deep learning approach. To take advantage of data from the last 5 years while not neglecting the initial parts of the sequence in the oldest years, an attention mechanism was used to model time series forecasting using deep learning. The attention mechanism was built on the foundation of the encoder-decoder approach in neural networks. Thus, with the use of an attention mechanism, the long-term dependency of the temperature predictions in a furnace was improved. A warm-up period in the training process of the neural network was implemented. The results of the attention-based mechanism were compared with the use of recurrent neural network architectures to deal with time series data, such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). The results of the Average Root Mean Square Error (ARMSE) obtained with the attention-based mechanism were the lowest. Finally, a variable importance study was performed to identify the best variables to train the model.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8880730PMC
http://dx.doi.org/10.3390/s22041418DOI Listing

Publication Analysis

Top Keywords

neural network
12
time series
12
attention mechanism
12
recurrent neural
8
electric arc
8
arc furnace
8
deep learning
8
attention-based mechanism
8
mechanism
5
attention-based deep
4

Similar Publications

Background: Chronic kidney disease (CKD) represents a significant public health challenge, with rates consistently on the rise. Enhancing kidney function prediction could contribute to the early detection, prevention, and management of CKD in clinical practice. We aimed to investigate whether deep learning techniques, especially those suitable for processing missing values, can improve the accuracy of predicting future renal function compared to traditional statistical method, using the Japan Chronic Kidney Disease Database (J-CKD-DB), a nationwide multicenter CKD registry.

View Article and Find Full Text PDF

Physiological responses derived from audiovisual perception during assisted driving are associated with the regulation of the autonomic nervous system (ANS), especially in emergencies. However, the interaction of event-related brain activity and the ANS regulating peripheral physiological indicators (i.e.

View Article and Find Full Text PDF

Impulse control disorders in Parkinson's disease: What's new?

J Neurol

January 2025

Parkinson's Disease Research Clinic, Macquarie University, 75 Talavera Road, Sydney, NSW, 2109, Australia.

Impulse Control Disorders (ICDs) are increasingly recognized as a significant non-motor complication in Parkinson's disease (PD), impacting patients and their caregivers. ICDs in PD are primarily associated with dopaminergic treatments, particularly dopamine agonists, though not all patients develop these disorders, indicating a role for genetic and other clinical factors. Studies over the past few years suggest that the mesocorticolimbic reward system, a core neural substrate for impulsivity, is a key contributor to ICDs in PD.

View Article and Find Full Text PDF

Intracranial atherosclerotic stenosis (ICAS) and intracranial aneurysms are prevalent conditions in the cerebrovascular system. ICAS causes a narrowing of the arterial lumen, thereby restricting blood flow, while aneurysms involve the ballooning of blood vessels. Both conditions can lead to severe outcomes, such as stroke or vessel rupture, which can be fatal.

View Article and Find Full Text PDF

Background: Hemorrhagic transformation (HT) is a complication of reperfusion therapy following acute ischemic stroke (AIS). We aimed to develop and validate a model for predicting HT and its subtypes with poor prognosis-parenchymal hemorrhage (PH), including PH-1 (hematoma within infarcted tissue, occupying < 30%) and PH-2 (hematoma occupying ≥ 30% of the infarcted tissue)-in AIS patients following intravenous thrombolysis (IVT) based on noncontrast computed tomography (NCCT) and clinical data.

Methods: In this six-center retrospective study, clinical and imaging data from 445 consecutive IVT-treated AIS patients were collected (01/2018-06/2023).

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!