Recent successes of foundation models in artificial intelligence have prompted the emergence of large-scale chemical pre-trained models. Despite the growing interest in large molecular pre-trained models that provide informative representations for downstream tasks, attempts for multimodal pre-training approaches on the molecule domain were limited. To address this, here we present a multimodal molecular pre-trained model that incorporates the modalities of structure and biochemical properties, drawing inspiration from recent advances in multimodal learning techniques. Our proposed model pipeline of data handling and training objectives aligns the structure/property features in a common embedding space, which enables the model to regard bidirectional information between the molecules' structure and properties. These contributions emerge synergistic knowledge, allowing us to tackle both multimodal and unimodal downstream tasks through a single model. Through extensive experiments, we demonstrate that our model has the capabilities to solve various meaningful chemical challenges, including conditional molecule generation, property prediction, molecule classification, and reaction prediction.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10940637PMC
http://dx.doi.org/10.1038/s41467-024-46440-3DOI Listing

Publication Analysis

Top Keywords

structure properties
8
pre-trained models
8
molecular pre-trained
8
downstream tasks
8
model
6
bidirectional generation
4
generation structure
4
properties single
4
single molecular
4
molecular foundation
4

Similar Publications

Computational insights into the redox properties and electronic structures of [Tc=O] complexes: Implications for Tc-radiopharmaceuticals.

J Mol Graph Model

January 2025

"VINČA" Institute of Nuclear Sciences - National Institute of the Republic of Serbia, University of Belgrade, 11001, Belgrade, Serbia.

Technetium-99m plays a pivotal role in nuclear medicine, offering unique IMAGING capabilities due to its favorable physical and chemical properties. This study investigates the redox behavior and electronic structures of three representative Tc(V) oxo complexes, [TcO(HMPAO)], [TcO(Bicisate)], and [TcO(DMSA)], using computational techniques. Employing relativistic density functional theory with the Zero-Order Regular Approximation (ZORA), we analyze singlet-triplet energy gaps, Gibbs free energy changes, and redox potentials in neutral and acidic environments.

View Article and Find Full Text PDF

A multiscale molecular structural neural network for molecular property prediction.

Mol Divers

January 2025

Key Laboratory for Macromolecular Science of Shaanxi Province, School of Chemistry and Chemical Engineering, Shaanxi Normal University, Xi'an, 710119, People's Republic of China.

Molecular Property Prediction (MPP) is a fundamental task in important research fields such as chemistry, materials, biology, and medicine, where traditional computational chemistry methods based on quantum mechanics often consume substantial time and computing power. In recent years, machine learning has been increasingly used in computational chemistry, in which graph neural networks have shown good performance in molecular property prediction tasks, but they have some limitations in terms of generalizability, interpretability, and certainty. In order to address the above challenges, a Multiscale Molecular Structural Neural Network (MMSNet) is proposed in this paper, which obtains rich multiscale molecular representations through the information fusion between bonded and non-bonded "message passing" structures at the atomic scale and spatial feature information "encoder-decoder" structures at the molecular scale; a multi-level attention mechanism is introduced on the basis of theoretical analysis of molecular mechanics in order to enhance the model's interpretability; the prediction results of MMSNet are used as label values and clustered in the molecular library by the K-NN (K-Nearest Neighbors) algorithm to reverse match the spatial structure of the molecules, and the certainty of the model is quantified by comparing virtual screening results across different K-values.

View Article and Find Full Text PDF

Computational analysis of linear chain of holey nanographene and their molecular characterizations.

J Mol Model

January 2025

PG & Research Department of Mathematics, Sanatana Dharma College, Kerala University, Alappuzha, Kerala, 688003, India.

Holey nanographene, an allotrope of carbon arranged in two dimensions, has gained remarkable attention as a nanomaterial with several potential uses in numerous industries, such as electronics, energy storage, healthcare, and environmental cleanup, because of its high carrier mobility, flexibility, transparency, high surface area, conductivity, and chemical stability. The fundamental holey nanographene is assembled in a linear form to create the holey nanographene chain (HNC) that is being discussed. To fully utilize it in various applications, it is essential to comprehend the basic ideas guiding its behavior at the nanoscale; for that, we find various topological indices for this holey nanographene chain using the cut method.

View Article and Find Full Text PDF

Photoassisted lithium-sulfur (Li-S) batteries offer a promising approach to enhance the catalytic transformation kinetics of polysulfide. However, the development is greatly hindered by inadequate photo absorption and severe photoexcited carriers recombination. Herein, a photonic crystal sulfide heterojunction structure is designed as a bifunctional electrode scaffold for photoassisted Li-S batteries.

View Article and Find Full Text PDF

The interfacial mechanical characteristics of sandwich structures are crucial in defining the comprehensive mechanical performance of the whole structure. Nevertheless, in practical applications, the interface often emerges as the weakest segment due to potential defects in the interface of porous metal sandwich plates (PMSP). This study aims to explore the regulatory mechanisms influencing the mechanical characteristics of nano-SiO-reinforced aluminum foam sandwich structure (AFS) interfaces and to propose an effective strategy to achieve AFS interfaces with superior and stable mechanical properties.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!