Lightweight Siamese Network with Global Correlation for Single-Object Tracking.

Sensors (Basel)

Department of Automation, Xiamen University, Xiamen 361102, China.

Published: December 2024

Recent advancements in the field of object tracking have been notably influenced by Siamese-based trackers, which have demonstrated considerable progress in their performance and application. Researchers frequently emphasize the precision of trackers, yet they tend to neglect the associated complexity. This oversight can restrict real-time performance, rendering these trackers inadequate for specific applications. This study presents a novel lightweight Siamese network tracker, termed SiamGCN, which incorporates global feature fusion alongside a lightweight network architecture to improve tracking performance on devices with limited resources. MobileNet-V3 was chosen as the backbone network for feature extraction, with modifications made to the stride of its final layer to enhance extraction efficiency. A global correlation module, which was founded on the Transformer architecture, was developed utilizing a multi-head cross-attention mechanism. This design enhances the integration of template and search region features, thereby facilitating more precise and resilient tracking capabilities. The model underwent evaluation across four prominent tracking benchmarks: VOT2018, VOT2019, LaSOT, and TrackingNet. The results indicate that SiamGCN achieves high tracking performance while simultaneously decreasing the number of parameters and computational costs. This results in significant benefits regarding processing speed and resource utilization.

Download full-text PDF

Source
http://dx.doi.org/10.3390/s24248171DOI Listing

Publication Analysis

Top Keywords

lightweight siamese
8
siamese network
8
global correlation
8
tracking performance
8
tracking
6
network
4
network global
4
correlation single-object
4
single-object tracking
4
tracking advancements
4

Similar Publications

Lightweight Siamese Network with Global Correlation for Single-Object Tracking.

Sensors (Basel)

December 2024

Department of Automation, Xiamen University, Xiamen 361102, China.

Recent advancements in the field of object tracking have been notably influenced by Siamese-based trackers, which have demonstrated considerable progress in their performance and application. Researchers frequently emphasize the precision of trackers, yet they tend to neglect the associated complexity. This oversight can restrict real-time performance, rendering these trackers inadequate for specific applications.

View Article and Find Full Text PDF

Siamese comparative transformer-based network for unsupervised landmark detection.

PLoS One

December 2024

National Key Laboratory of Optical Field Manipulation Science and Technology, Chinese Academy of Sciences, Chengdu, China.

Landmark detection is a common task that benefits downstream computer vision tasks. Current landmark detection algorithms often train a sophisticated image pose encoder by reconstructing the source image to identify landmarks. Although a well-trained encoder can effectively capture landmark information through image reconstruction, it overlooks the semantic relationships between landmarks.

View Article and Find Full Text PDF

Few-Shot Learning-Based Light-Weight WDCNN Model for Bearing Fault Diagnosis in Siamese Network.

Sensors (Basel)

July 2023

Department of Smart Factory Convergence, Sungkyunkwan University, 2066 Seobu-ro, Jangan-gu, Suwon 16419, Republic of Korea.

Article Synopsis
  • This study focuses on diagnosing bearing faults using few-shot learning to overcome the challenge of limited training data typically found in manufacturing environments.
  • Current deep learning methods often require large datasets and are computationally intensive, which is not feasible due to varying fault types and rapid changes in manufacturing conditions.
  • The researchers introduced a model utilizing Depthwise Separable Convolution layers, optimizing hyperparameters to achieve better accuracy with fewer parameters compared to traditional models.
View Article and Find Full Text PDF

Automatic pavement texture recognition using lightweight few-shot learning.

Philos Trans A Math Phys Eng Sci

September 2023

Department of Civil Engineering, Faculty of Science and Engineering, Swansea University, Swansea SA1 8EN, UK.

Texture is a crucial characteristic of roads, closely related to their performance. The recognition of pavement texture is of great significance for road maintenance professionals to detect potential safety hazards and carry out necessary countermeasures. Although deep learning models have been applied for recognition, the scarcity of data has always been a limitation.

View Article and Find Full Text PDF

Photoplethysmogram Biometric Authentication Using a 1D Siamese Network.

Sensors (Basel)

May 2023

Department of Human-Centered Artificial Intelligence, Sangmyung University, Hongjimun 2-Gil 20, Jongno-Gu, Seoul 03016, Republic of Korea.

In the head-mounted display environment for experiencing metaverse or virtual reality, conventional input devices cannot be used, so a new type of nonintrusive and continuous biometric authentication technology is required. Since the wrist wearable device is equipped with a photoplethysmogram sensor, it is very suitable for use for nonintrusive and continuous biometric authentication purposes. In this study, we propose a one-dimensional Siamese network biometric identification model using a photoplethysmogram.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!