Enhanced deep unrolling networks for snapshot compressive hyperspectral imaging.

Neural Netw

Department of Mathematics, National University of Singapore, 119076, Singapore. Electronic address:

Published: June 2024

Snapshot compressive hyperspectral imaging necessitates the reconstruction of a complete hyperspectral image from its compressive snapshot measurement, presenting a challenging inverse problem. This paper proposes an enhanced deep unrolling neural network, called EDUNet, to tackle this problem. The EDUNet is constructed via the deep unrolling of a proximal gradient descent algorithm and introduces two innovative modules for gradient-driven update and proximal mapping reflectivity. The gradient-driven update module leverages a memory-assistant descent approach inspired by momentum-based acceleration techniques, for enhancing the unrolled reconstruction process and improving convergence. The proximal mapping is modeled by a sub-network with a cross-stage spectral self-attention, which effectively exploits the inherent self-similarities present in hyperspectral images along the spectral axis. It also enhances feature flow throughout the network, contributing to reconstruction performance gain. Furthermore, we introduce a spectral geometry consistency loss, encouraging EDUNet to prioritize the geometric layouts of spectral curves, leading to a more precise capture of spectral information in hyperspectral images. Experiments are conducted using three benchmark datasets including KAIST, ICVL, and Harvard, along with some real data, comprising a total of 73 samples. The experimental results demonstrate that EDUNet outperforms 15 competing models across four metrics including PSNR, SSIM, SAM, and ERGAS.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.106250DOI Listing

Publication Analysis

Top Keywords

deep unrolling
12
enhanced deep
8
snapshot compressive
8
compressive hyperspectral
8
hyperspectral imaging
8
gradient-driven update
8
proximal mapping
8
hyperspectral images
8
hyperspectral
5
spectral
5

Similar Publications

Adaptive Memory-Augmented Unfolding Network for Compressed Sensing.

Sensors (Basel)

December 2024

School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310023, China.

Deep unfolding networks (DUNs) have attracted growing attention in compressed sensing (CS) due to their good interpretability and high performance. However, many DUNs often improve the reconstruction effect at the price of a large number of parameters and have the problem of feature information loss during iteration. This paper proposes a novel adaptive memory-augmented unfolding network for compressed sensing (AMAUN-CS).

View Article and Find Full Text PDF

Objective: There have been many advancements in deep unrolling methods for sparse-view computed tomography (SVCT) reconstruction. These methods combine model-based and deep learning-based reconstruction techniques, improving the interpretability and achieving significant results. However, they are often computationally expensive, particularly for clinical raw projection data with large sizes.

View Article and Find Full Text PDF

Background: Recent advances in deep learning have sparked new research interests in dynamic magnetic resonance imaging (MRI) reconstruction. However, existing deep learning-based approaches suffer from insufficient reconstruction efficiency and accuracy due to the lack of time correlation modeling during the reconstruction procedure.

Purpose: Inappropriate tensor processing steps and deep learning models may lead to not only a lack of modeling in the time dimension but also an increase in the overall size of the network.

View Article and Find Full Text PDF

Lensless imaging has gained popularity in various applications due to its user-friendly nature, cost-effectiveness, and compact design. However, achieving high-quality image reconstruction within this framework remains a significant challenge. Lensless imaging measurements are associated with distinct point spread functions (PSFs), resulting in many PSFs introducing artifacts into the underlying physical model.

View Article and Find Full Text PDF

Blip-up blip-down circular EPI (BUDA-cEPI) for distortion-free dMRI with rapid unrolled deep learning reconstruction.

Magn Reson Imaging

January 2025

Department of Radiology, Stanford University, Stanford, CA, USA; Department of Electrical Engineering, Stanford University, Stanford, CA, USA. Electronic address:

Purpose: BUDA-cEPI has been shown to achieve high-quality, high-resolution diffusion magnetic resonance imaging (dMRI) with fast acquisition time, particularly when used in conjunction with S-LORAKS reconstruction. However, this comes at a cost of more complex reconstruction that is computationally prohibitive. In this work we develop rapid reconstruction pipeline for BUDA-cEPI to pave the way for its deployment in routine clinical and neuroscientific applications.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!