Spectral super-resolution aims to reconstruct a hyperspectral image (HSI) from its corresponding RGB image, which has drawn much more attention in remote sensing field. Recent advances in the application of deep learning models for spectral super-resolution have demonstrated great potential. However, these methods only work in spectral-spatial domain while rarely explore the potential property in the frequency domain. In this work, we first attempt to address spectral super-resolution in the frequency domain. To well merge the frequency information into the super-resolution network, a spectral-spatial-frequency domain fusion network (SSFDF) is designed, which consists of three key parts: frequency-domain feature learning, spectral-spatial domain feature learning, and feature fusion module. In more detail, a frequency-domain feature learning network is first exploited to dig the frequency-domain information of the input data. Then, a symmetric convolutional neural network (CNN) is developed to acquire the spectral-spatial features of the input data, where a parameter-sharing strategy is utilized to reduce network parameters. Finally, a feature fusion module is proposed to reconstruct HSI. Comprehensive experiments on several datasets reveal that our method can attain state-of-the-art reconstruction result with respect to other spectral super-resolution techniques.
Download full-text PDF |
Source |
---|---|
http://dx.doi.org/10.1109/TNNLS.2024.3481060 | DOI Listing |
Light Sci Appl
January 2025
Center for Biomedical Optics and Photonics & College of Physics and Optoelectronic Engineering, Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, Shenzhen University, Shenzhen, 518060, China.
Multicolor microscopy and super-resolution optical microscopy are two widely used techniques that greatly enhance the ability to distinguish and resolve structures in cellular imaging. These methods have individually transformed cellular imaging by allowing detailed visualization of cellular and subcellular structures, as well as organelle interactions. However, integrating multicolor and super-resolution microscopy into a single method remains challenging due to issues like spectral overlap, crosstalk, photobleaching, phototoxicity, and technical complexity.
View Article and Find Full Text PDFSci Rep
December 2024
School of Electronic Information and Automation, Tianjin, China.
Vision transformers have garnered substantial attention and attained impressive performance in image super-resolution tasks. Nevertheless, these networks face challenges associated with attention complexity and the effective capture of intricate, fine-grained details within images. These hurdles impede the efficient and scalable deployment of transformer models for image super-resolution tasks in real-world applications.
View Article and Find Full Text PDFNanophotonics
January 2024
Department of Chemistry, Hanyang University, Seoul 04763, Republic of Korea.
The recent advances in super-resolution fluorescence microscopy, including single-molecule localization microscopy (SMLM), has enabled the study of previously inaccessible details, such as the organization of proteins within cellular compartments and even nanostructures in nonbiological nanomaterials, such as the polymers and semiconductors. With such developments, the need for the development of various computational nanostructure analysis methods for SMLM images is also increasing; however, this has been limited to protein cluster analysis. In this study, we developed an edge structure analysis method for pointillistic SMLM images based on the line edge roughness and power spectral density analyses.
View Article and Find Full Text PDFSci Rep
December 2024
Department of Information Technology, Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal, India.
Hyperspectral remote sensing images obtained from cameras are characterized by high-dimensions and low quality, which makes them unfavorable for various analytics purposes. This is due to the presence of visible and invisible frequencies of the reflected light making it poorly reveal the spectral signatures of the image. Visual communication advancement has paved the need for Image Super-Resolution (SR) which recovers high-resolution images from low-resolution images.
View Article and Find Full Text PDFSci Rep
November 2024
Department of Electrical Engineering, Shiraz University of Technology, Shiraz, Iran.
Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!