Parameter Adaptive Contrastive Hashing for multimedia retrieval.

Neural Netw

Big Data Institute, School of Computer Science and Engineering, Central South University, ChangSha, Hunan, 410000, China. Electronic address:

Published: February 2025

With the emergence of massive amounts of multi-source heterogeneous data on the Internet, quickly retrieving effective information from this extensive data has become a hot research topic. Due to the efficiency and speed of hash learning methods in multimedia retrieval, they have become a mainstream method for multimedia retrieval. However, unsupervised multimedia hash learning methods still face challenges with the difficulties of tuning due to the excessive number of hyperparameters and the lack of precise guidance on semantic similarity. To address these problems, we propose a Parameter Adaptive Contrastive Hashing (PACH) method for multimedia retrieval. The Fast Parameter Adaptive (FPA) module, combined with the powerful space exploration and dynamic optimization capabilities of reinforcement learning, designs a hot-plugging multimedia hashing method parameter adaptation module to solve for an approximate optimal combination of parameters. The Multimedia Contrastive Hashing (MCH) module comprehensively explores intra- and inter-modal semantic consistency of multimodal data, enriching the cross-modal semantic information of the hash codes. Comprehensive experiments were designed and compared with the latest hash learning methods, verifying the effectiveness and superiority of the PACH method. The code is available at https://github.com/YunfeiChenMY/PACH.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.106923DOI Listing

Publication Analysis

Top Keywords

multimedia retrieval
16
parameter adaptive
12
contrastive hashing
12
hash learning
12
learning methods
12
adaptive contrastive
8
method multimedia
8
pach method
8
multimedia
7
parameter
4

Similar Publications

Massively parallel homogeneous amplification of chip-scale DNA for DNA information storage (MPHAC-DIS).

Nat Commun

January 2025

School of Chemistry and Chemical Engineering, New Cornerstone Science Laboratory, Frontiers Science Center for Transformative Molecules, National Center for Translational Medicine, Shanghai Jiao Tong University, Shanghai, China.

Chip scale DNA synthesis offers a high-throughput and cost-effective method for large-scale DNA-based information storage. Nevertheless, unbiased information retrieval from low-copy-number sequences remains a barricade that largely arises from the indispensable DNA amplification. Here, we devise a simulation-guided quantitative primer-template hybridization strategy to realize massively parallel homogeneous amplification of chip-scale DNA for DNA information storage (MPHAC-DIS).

View Article and Find Full Text PDF

The paper presents a double-radio wireless multimedia sensor node (WMSN) with a camera on board, designed for plant proximal monitoring. Camera sensor nodes represent an effective solution to monitor the crop at the leaf or fruit scale, with details that cannot be retrieved with the same precision through satellites or unnamed aerial vehicles (UAVs). From the technological point of view, WMSNs are characterized by very different requirements, compared to standard wireless sensor nodes; in particular, the network data rate results in higher energy consumption and incompatibility with the usage of battery-powered devices.

View Article and Find Full Text PDF

Deep learning-based information retrieval with normalized dominant feature subset and weighted vector model.

PeerJ Comput Sci

January 2024

School of Computer Science and Engineering, VIT-AP University, Amaravati, Andhra Pradesh, India.

Multimedia data, which includes textual information, is employed in a variety of practical computer vision applications. More than a million new records are added to social media and news sites every day, and the text content they contain has gotten increasingly complex. Finding a meaningful text record in an archive might be challenging for computer vision researchers.

View Article and Find Full Text PDF

Parameter Adaptive Contrastive Hashing for multimedia retrieval.

Neural Netw

February 2025

Big Data Institute, School of Computer Science and Engineering, Central South University, ChangSha, Hunan, 410000, China. Electronic address:

With the emergence of massive amounts of multi-source heterogeneous data on the Internet, quickly retrieving effective information from this extensive data has become a hot research topic. Due to the efficiency and speed of hash learning methods in multimedia retrieval, they have become a mainstream method for multimedia retrieval. However, unsupervised multimedia hash learning methods still face challenges with the difficulties of tuning due to the excessive number of hyperparameters and the lack of precise guidance on semantic similarity.

View Article and Find Full Text PDF

Spatial-Aware and Load Balancing Distributed Data Partitioning Strategies for Content-Based Multimedia Retrieval.

Res Sq

September 2024

Department of Computer Science, Universidade Federal de Minas Gerais, Belo Horizonte, Minas Gerais, Brazil.

Content-Based Multimedia Retrieval (CBMR) has become very popular in several applications, driven by the growing routine use of multimedia data. Since the datasets used in real-world applications are very large and descriptor's dimensionality is high, querying is an expensive, albeit important functionality. Further, exact search is prohibitive in most cases, motivating the use of Approximate Nearest Neighbour Search (ANNS) algorithms, trading accuracy for performance.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!