Spectral Super-Resolution in Frequency Domain.

IEEE Trans Neural Netw Learn Syst

Published: October 2024

Spectral super-resolution aims to reconstruct a hyperspectral image (HSI) from its corresponding RGB image, which has drawn much more attention in remote sensing field. Recent advances in the application of deep learning models for spectral super-resolution have demonstrated great potential. However, these methods only work in spectral-spatial domain while rarely explore the potential property in the frequency domain. In this work, we first attempt to address spectral super-resolution in the frequency domain. To well merge the frequency information into the super-resolution network, a spectral-spatial-frequency domain fusion network (SSFDF) is designed, which consists of three key parts: frequency-domain feature learning, spectral-spatial domain feature learning, and feature fusion module. In more detail, a frequency-domain feature learning network is first exploited to dig the frequency-domain information of the input data. Then, a symmetric convolutional neural network (CNN) is developed to acquire the spectral-spatial features of the input data, where a parameter-sharing strategy is utilized to reduce network parameters. Finally, a feature fusion module is proposed to reconstruct HSI. Comprehensive experiments on several datasets reveal that our method can attain state-of-the-art reconstruction result with respect to other spectral super-resolution techniques.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TNNLS.2024.3481060DOI Listing

Publication Analysis

Top Keywords

spectral super-resolution
20
frequency domain
12
feature learning
12
super-resolution frequency
8
spectral-spatial domain
8
frequency-domain feature
8
feature fusion
8
fusion module
8
input data
8
domain
6

Similar Publications

Phasor-FSTM: a new paradigm for multicolor super-resolution imaging of living cells based on fluorescence modulation and lifetime multiplexing.

Light Sci Appl

January 2025

Center for Biomedical Optics and Photonics & College of Physics and Optoelectronic Engineering, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, Shenzhen University, Shenzhen, 518060, China.

Multicolor microscopy and super-resolution optical microscopy are two widely used techniques that greatly enhance the ability to distinguish and resolve structures in cellular imaging. These methods have individually transformed cellular imaging by allowing detailed visualization of cellular and subcellular structures, as well as organelle interactions. However, integrating multicolor and super-resolution microscopy into a single method remains challenging due to issues like spectral overlap, crosstalk, photobleaching, phototoxicity, and technical complexity.

View Article and Find Full Text PDF

Vision transformers have garnered substantial attention and attained impressive performance in image super-resolution tasks. Nevertheless, these networks face challenges associated with attention complexity and the effective capture of intricate, fine-grained details within images. These hurdles impede the efficient and scalable deployment of transformer models for image super-resolution tasks in real-world applications.

View Article and Find Full Text PDF

The recent advances in super-resolution fluorescence microscopy, including single-molecule localization microscopy (SMLM), has enabled the study of previously inaccessible details, such as the organization of proteins within cellular compartments and even nanostructures in nonbiological nanomaterials, such as the polymers and semiconductors. With such developments, the need for the development of various computational nanostructure analysis methods for SMLM images is also increasing; however, this has been limited to protein cluster analysis. In this study, we developed an edge structure analysis method for pointillistic SMLM images based on the line edge roughness and power spectral density analyses.

View Article and Find Full Text PDF

Hyperspectral remote sensing images obtained from cameras are characterized by high-dimensions and low quality, which makes them unfavorable for various analytics purposes. This is due to the presence of visible and invisible frequencies of the reflected light making it poorly reveal the spectral signatures of the image. Visual communication advancement has paved the need for Image Super-Resolution (SR) which recovers high-resolution images from low-resolution images.

View Article and Find Full Text PDF
Article Synopsis
  • Hyperspectral-multispectral image fusion (HSI-MSI Fusion) is gaining attention in remote sensing for improving the resolution of hyperspectral images, especially using deep learning techniques.
  • A major challenge for deep learning in this area includes limited training data, difficulty adapting to varied datasets, and significant computational demands.
  • This paper presents a novel method that utilizes a small deep neural network to create high-resolution hyperspectral images from multispectral images without needing high-resolution training data, effectively addressing data scarcity and reducing computational costs, with promising experimental results.
View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!