Neural network emulator for atmospheric chemical ODE.

Neural Netw

School of Engineering Sciences, Lappeenranta-Lahti University of Technology LUT, Lahti, 15110, Finland; Atmospheric Modelling Centre Lahti, Lahti University Campus, Lahti, 15140, Finland; Institute for Atmospheric and Earth System Research (INAR), The University of Helsinki, Helsinki, 00014, Finland.

Published: January 2025

AI Article Synopsis

  • Modelling atmospheric chemistry is complicated and involves intensive computations; however, the proposed ChemNNE uses Deep Neural Networks to quickly simulate chemical concentrations by treating them as time-dependent equations.
  • This emulator employs an attention-based mechanism, sinusoidal time embedding for capturing periodic patterns, and a Fourier neural operator to improve efficiency and handle complex behaviors in the chemical processes.
  • The model is trained with three physics-informed loss functions to adhere to conservation laws and reaction rates, and it is validated using a large-scale dataset that sets a benchmark for accuracy and speed in future research.

Article Abstract

Modelling atmospheric chemistry is complex and computationally intense. Given the recent success of Deep neural networks in digital signal processing, we propose a Neural Network Emulator for fast chemical concentration modelling. We consider atmospheric chemistry as a time-dependent Ordinary Differential Equation. To extract the hidden correlations between initial states and future time evolution, we propose ChemNNE, an Attention based Neural Network Emulator (NNE) that can model the atmospheric chemistry as a neural ODE process. To efficiently capture temporal patterns in chemical concentration changes, we implement sinusoidal time embedding to represent periodic tendencies over time. Additionally, we leverage the Fourier neural operator to model the ODE process, enhancing computational efficiency and facilitating the learning of complex dynamical behaviour. We introduce three physics-informed loss functions, targeting conservation laws and reaction rate constraints, to guide the training optimization process. To evaluate our model, we introduce a unique, large-scale chemical dataset designed for neural network training and validation, which can serve as a benchmark for future studies. The extensive experiments show that our approach achieves state-of-the-art performance in modelling accuracy and computational speed.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.107106DOI Listing

Publication Analysis

Top Keywords

neural network
16
network emulator
12
atmospheric chemistry
12
chemical concentration
8
ode process
8
neural
7
atmospheric
4
emulator atmospheric
4
chemical
4
atmospheric chemical
4

Similar Publications

The accurate non-invasive detection and estimation of central aortic pressure waveforms (CAPW) are crucial for reliable treatments of cardiovascular system diseases. But the accuracy and practicality of current estimation methods need to be improved. Our study combines a meta-learning neural network and a physics-driven method to accurately estimate CAPW based on personalized physiological indicators.

View Article and Find Full Text PDF

STMGraph: spatial-context-aware of transcriptomes via a dual-remasked dynamic graph attention model.

Brief Bioinform

November 2024

Center for Genomics and Biotechnology, Fujian Provincial Key Laboratory of Haixia Applied Plant Systems Biology, Haixia Institute of Science and Technology, Fujian Agriculture and Forestry University, No. 15 Shangxiadian Road, Cangshan District, Fuzhou 350002, China.

Spatial transcriptomics (ST) technologies enable dissecting the tissue architecture in spatial context. To perceive the global contextual information of gene expression patterns in tissue, the spatial dependence of cells must be fully considered by integrating both local and non-local features by means of spatial-context-aware. However, the current ST integration algorithm ignores for ST dropouts, which impedes the spatial-aware of ST features, resulting in challenges in the accuracy and robustness of microenvironmental heterogeneity detecting, spatial domain clustering, and batch-effects correction.

View Article and Find Full Text PDF

Background: Deutetrabenazine is a widely used drug for the treatment of tardive dyskinesia (TD), and post-marketing testing is important. There is a lack of real-world, large-sample safety studies of deutetrabenazine. In this study, a pharmacovigilance analysis of deutetrabenazine was performed based on the FDA Adverse Event Reporting System (FAERS) database to evaluate its relevant safety signals for clinical reference.

View Article and Find Full Text PDF

The early symptoms of hepatocellular carcinoma patients are often subtle and easily overlooked. By the time patients exhibit noticeable symptoms, the disease has typically progressed to middle or late stages, missing optimal treatment opportunities. Therefore, discovering biomarkers is essential for elucidating their functions for the early diagnosis and prevention.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!