Visible-infrared person re-identification (VI-ReID) is a challenging cross-modality retrieval task to match a person across different spectral camera views. Most existing works focus on learning shared feature representations from the final embedding space of advanced networks to alleviate modality differences between visible and infrared images. However, exclusively relying on high-level semantic information from the network's final layers can restrict shared feature representations and overlook the benefits of low-level details. Different from these methods, we propose a multi-scale contrastive learning network (MCLNet) with hierarchical knowledge synergy for VI-ReID. MCLNet is a novel two-stream contrastive deep supervision framework designed to train low-level details and high-level semantic representations simultaneously. MCLNet utilizes supervised contrastive learning (SCL) at each intermediate layer to strengthen visual representations and enhance cross-modality feature learning. Furthermore, a hierarchical knowledge synergy (HKS) strategy for pairwise knowledge matching promotes explicit information interaction across multi-scale features and improves information consistency. Extensive experiments on three benchmarks demonstrate the effectiveness of MCLNet.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11722841PMC
http://dx.doi.org/10.3390/s25010192DOI Listing

Publication Analysis

Top Keywords

contrastive learning
12
hierarchical knowledge
12
knowledge synergy
12
multi-scale contrastive
8
learning hierarchical
8
visible-infrared person
8
person re-identification
8
shared feature
8
feature representations
8
high-level semantic
8

Similar Publications

Unleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-Identification.

Sensors (Basel)

January 2025

College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China.

Domain-generalizable re-identification (DG Re-ID) aims to train a model on one or more source domains and evaluate its performance on unseen target domains, a task that has attracted growing attention due to its practical relevance. While numerous methods have been proposed, most rely on discriminative or contrastive learning frameworks to learn generalizable feature representations. However, these approaches often fail to mitigate shortcut learning, leading to suboptimal performance.

View Article and Find Full Text PDF

Elephant Sound Classification Using Deep Learning Optimization.

Sensors (Basel)

January 2025

School of Computer Science and Informatics, Cardiff University, Cardiff CF24 3AA, UK.

Elephant sound identification is crucial in wildlife conservation and ecological research. The identification of elephant vocalizations provides insights into the behavior, social dynamics, and emotional expressions, leading to elephant conservation. This study addresses elephant sound classification utilizing raw audio processing.

View Article and Find Full Text PDF

: The development of microsurgical techniques has enabled reconstructive versatility in various clinical scenarios. Supermicrosurgery is an advanced microsurgical technique ensuring precise reconstructions by operating on small-caliber vessels and nerves, with applications in reconstructive surgeries. : This study aims to compare the effectiveness of four low-cost training models, thereby improving surgical precision and reducing the learning curve for novice surgeons.

View Article and Find Full Text PDF

Keratoconus is a progressive corneal disorder that can lead to irreversible visual impairment if not detected early. Despite its high prevalence, early diagnosis is often delayed, especially in low-to-middle-income countries due to limited awareness and restricted access to advanced diagnostic tools such as corneal topography, tomography, optical coherence tomography, and corneal biomechanical assessments. These technologies are essential for identifying early-stage keratoconus, yet their high cost limits accessibility in resource-limited settings.

View Article and Find Full Text PDF

There has been accumulating evidence over the past two decades that metformin can be an effective treatment for gestational diabetes mellitus (GDM) in women whose diet and exercise fail to attain optimal glycemic control. The objective of this review was to comprehensively analyze all studies investigating the effectiveness of metformin compared to insulin and other drugs utilized for the treatment of GDM. After a comprehensive literature review based on PRISMA 2020, 35 studies were included after a selection process utilizing predetermined inclusion and exclusion criteria.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!