Interactive Feature Embedding for Infrared and Visible Image Fusion.

IEEE Trans Neural Netw Learn Syst

Published: September 2024

General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TNNLS.2023.3264911DOI Listing

Publication Analysis

Top Keywords

infrared visible
16
visible image
16
image fusion
16
interactive feature
12
feature embedding
12
self-supervised learning
12
unsupervised mechanism
8
vital retention
8
source images
8
learning framework
8

Similar Publications

Compartmentalizing Donor-Acceptor Stenhouse Adducts for Structure-Property Relationship Analysis.

J Am Chem Soc

December 2024

Department of Chemistry, Loker Hydrocarbon Research Institute, University of Southern California, Los Angeles, California 90089, United States.

The development of photoswitches that absorb low energy light is of notable interest due to the growing demand for smart materials and therapeutics necessitating benign stimuli. Donor-acceptor Stenhouse adducts (DASAs) are molecular photoswitches that respond to light in the visible to near-infrared spectrum. As a result of their modular assembly, DASAs can be modified at the donor, acceptor, triene, and backbone heteroatom molecular compartments for the tuning of optical and photoswitching properties.

View Article and Find Full Text PDF

An Efficient and Flexible Bifunctional Dual-Band Electrochromic Device Integrating with Energy Storage.

Nanomicro Lett

December 2024

Jiangsu Key Laboratory of Electrochemical Energy Storage Technologies, College of Materials Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, People's Republic of China.

Dual-band electrochromic devices capable of the spectral-selective modulation of visible (VIS) light and near-infrared (NIR) can notably reduce the energy consumption of buildings and improve the occupants' visual and thermal comfort. However, the low optical modulation and poor durability of these devices severely limit its practical applications. Herein, we demonstrate an efficient and flexible bifunctional dual-band electrochromic device which not only shows excellent spectral-selective electrochromic performance with a high optical modulation and a long cycle life, but also displays a high capacitance and a high energy recycling efficiency of 51.

View Article and Find Full Text PDF

Chiral molecules are ubiquitous in nature and biological systems, where the unique optical and physical properties of chiral nanoparticles are closely linked to their shapes. Synthesizing chiral plasmonic nanomaterials with precise structures and tunable sizes is essential for exploring their applications. This study presents a method for growing three-dimensional chiral gold nanoflowers (Au NFs) derived from trisoctahedral (TOH) nanocrystals using D-cysteine and L-cysteine as chiral inducers.

View Article and Find Full Text PDF

The rapid progress in nanotechnology has introduced multifunctional iron oxide nanoparticles as promising agents in cancer treatment. This research focused on the synthesis and assessment of citric-acid-coated, folic-acid-conjugated nanoparticles loaded with doxorubicin, evaluating their therapeutic potential in tumor models. An advanced automated continuous technology line (CTL) utilizing a controlled co-precipitation method was employed to produce highly dispersive, multifunctional nanofluids with a narrow size distribution.

View Article and Find Full Text PDF

A Novel Dual Cross-linking Reagent for Dentin Bonding Interface Stability.

J Dent Res

December 2024

State Key Lab of Supramolecular Structure and Materials, College of Chemistry, Jilin University, Changchun, China.

The cross-linking reagent has been proposed as a means of modifying dentin collagen, inhibiting matrix metalloproteinase activities, and enhancing bond durability during dentin bonding procedures. This study aimed to synthesize an operation-friendly dual cross-linking reagent-3-(4-formyphenoxy)-2-hydroxypropyl methacrylate (FPA)-to assess its ability to cross-link dentin collagen and reduce enzymatic activity at the bonding interface. Cytotoxicity was evaluated by a cell counting kit-8 test and calcein AM/propidium iodide assay.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!