Contrastive Graph Representation Learning with Adversarial Cross-View Reconstruction and Information Bottleneck.

Neural Netw

School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an, 710049, China; Ministry of Education Key Laboratory for Intelligent Networks and Network Security, Xi'an Jiaotong University, Xi'an, 710049, China. Electronic address:

Published: January 2025

Graph Neural Networks (GNNs) have received extensive research attention due to their powerful information aggregation capabilities. Despite the success of GNNs, most of them suffer from the popularity bias issue in a graph caused by a small number of popular categories. Additionally, real graph datasets always contain incorrect node labels, which hinders GNNs from learning effective node representations. Graph contrastive learning (GCL) has been shown to be effective in solving the above problems for node classification tasks. Most existing GCL methods are implemented by randomly removing edges and nodes to create multiple contrasting views, and then maximizing the mutual information (MI) between these contrasting views to improve the node feature representation. However, maximizing the mutual information between multiple contrasting views may lead the model to learn some redundant information irrelevant to the node classification task. To tackle this issue, we propose an effective Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneck (CGRL) for node classification, which can adaptively learn to mask the nodes and edges in the graph to obtain the optimal graph structure representation. Furthermore, we innovatively introduce the information bottleneck theory into GCLs to remove redundant information in multiple contrasting views while retaining as much information as possible about node classification. Moreover, we add noise perturbations to the original views and reconstruct the augmented views by constructing adversarial views to improve the robustness of node feature representation. We also verified through theoretical analysis the effectiveness of this cross-attempt reconstruction mechanism and information bottleneck theory in capturing graph structure information and improving model generalization performance. Extensive experiments on real-world public datasets demonstrate that our method significantly outperforms existing state-of-the-art algorithms.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.107094DOI Listing

Publication Analysis

Top Keywords

node classification
16
contrasting views
16
multiple contrasting
12
contrastive graph
8
graph representation
8
representation learning
8
learning adversarial
8
adversarial cross-view
8
cross-view reconstruction
8
reconstruction bottleneck
8

Similar Publications

Introduction: Pulmonary high-grade neuroendocrine carcinoma (NEC) includes small cell lung carcinoma (SCLC) and large cell neuroendocrine carcinoma (LCNEC). The seventh and eighth editions of the TNM classification for lung cancer confirmed the applicability of this staging system for SCLC. With the proposal of N2 and M1c subcategories for the ninth edition classification, we assessed the applicability to NECs.

View Article and Find Full Text PDF

Interleukin-6 (IL-6) is a potent glycoprotein that plays a crucial role in regulating innate and adaptive immunity, as well as metabolism. The expression and release of IL-6 are closely correlated with the severity of various diseases. IL-6-inducing peptides are critical for the development of immunotherapy and diagnostic biomarkers for some diseases.

View Article and Find Full Text PDF

Background: Muscle-invasive bladder carcinomas (MIBCs) exhibit significant heterogeneity, with diverse histopathological features associated with varied prognosis and therapeutic response. Although genomic profiling studies have identified several molecular subtypes of MIBC, two basic molecular subtypes are identified - luminal and basal, differing in biological behaviour and response to treatment. As molecular subtyping is complex, surrogate immunohistochemical (IHC) markers have been used to determine the molecular subtypes with good correlation to genomic profiling.

View Article and Find Full Text PDF

Hypertension is a critical risk factor and cause of mortality in cardiovascular diseases, and it remains a global public health issue. Therefore, understanding its mechanisms is essential for treating and preventing hypertension. Gene expression data is an important source for obtaining hypertension biomarkers.

View Article and Find Full Text PDF

Endobronchial ultrasound-guided transbronchial needle aspiration (EBUS-TBNA) is a cornerstone in minimally invasive thoracic lymph node sampling. In lung cancer staging, precise assessment of lymph node position is crucial for clinical decision-making. This study aimed to demonstrate a new deep learning method to classify thoracic lymph nodes based on their anatomical location using EBUS images.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!