Multi-shot coded aperture snapshot spectral imaging (CASSI) uses multiple measurement snapshots to encode the three-dimensional hyperspectral image (HSI). Increasing the number of snapshots will multiply the number of measurements, making CASSI system more appropriate for detailed spatial or spectrally rich scenes. However, the reconstruction algorithms still face the challenge of being ineffective or inflexible. In this paper, we propose a plug-and-play (PnP) method that uses denoiser as priors for multi-shot CASSI. Specifically, the proposed PnP method is based on the primal-dual algorithm with linesearch (PDAL), which makes it flexible and can be used for any multi-shot CASSI mechanisms. Furthermore, a new subspaced-based nonlocal reweighted low-rank (SNRL) denoiser is presented to utilize the global spectral correlation and nonlocal self-similarity priors of HSI. By integrating the SNRL denoiser into PnP-PDAL, we show the balloons ( 512×512×31 ) in CAVE dataset recovered from two snapshots compressive measurements with MPSNR above 50 dB. Experimental results demonstrate that our proposed method leads to significant improvements compared to the current state-of-the-art methods.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TIP.2023.3315141DOI Listing

Publication Analysis

Top Keywords

priors multi-shot
8
pnp method
8
multi-shot cassi
8
snrl denoiser
8
plug-and-play priors
4
multi-shot
4
multi-shot compressive
4
compressive hyperspectral
4
hyperspectral imaging
4
imaging multi-shot
4

Similar Publications

Simultaneous Concentration and T Mapping of Brain Metabolites by Fast Multi-Echo Spectroscopic Imaging.

NMR Biomed

February 2025

MR Methodology, Department for Diagnostic and Interventional Neuroradiology, University of Bern, Bern, Switzerland.

The purpose of this study was to produce metabolite-specific T and concentration maps in a clinically compatible time frame. A multi-TE 2D MR spectroscopic imaging (MRSI) experiment (multi-echo single-shot MRSI [MESS-MRSI]) deployed truncated and partially sampled multi-echo trains from single scans and was combined with simultaneous multiparametric model fitting. It was tested in vivo for the brain in five healthy subjects.

View Article and Find Full Text PDF

Neural space-time model for dynamic multi-shot imaging.

Nat Methods

December 2024

Department of Electrical Engineering and Computer Sciences, UC Berkeley, Berkeley, CA, USA.

Computational imaging reconstructions from multiple measurements that are captured sequentially often suffer from motion artifacts if the scene is dynamic. We propose a neural space-time model (NSTM) that jointly estimates the scene and its motion dynamics, without data priors or pre-training. Hence, we can both remove motion artifacts and resolve sample dynamics from the same set of raw measurements used for the conventional reconstruction.

View Article and Find Full Text PDF

Multi-shot coded aperture snapshot spectral imaging (CASSI) uses multiple measurement snapshots to encode the three-dimensional hyperspectral image (HSI). Increasing the number of snapshots will multiply the number of measurements, making CASSI system more appropriate for detailed spatial or spectrally rich scenes. However, the reconstruction algorithms still face the challenge of being ineffective or inflexible.

View Article and Find Full Text PDF

With the emergence of new data collection ways in many dynamic environment applications, the samples are gathered gradually in the accumulated feature spaces. With the incorporation of new type features, it may result in the augmentation of class numbers. For instance, in activity recognition, using the old features during warm-up, we can separate different warm-up exercises.

View Article and Find Full Text PDF

Objective: Multi-shot interleaved echo planer imaging (Ms-iEPI) can obtain diffusion-weighted images (DWI) with high spatial resolution and low distortion, but suffers from ghost artifacts introduced by phase variations between shots. In this work, we aim at solving the ms-iEPI DWI reconstructions under inter-shot motions and ultra-high b-values.

Methods: An iteratively joint estimation model with paired phase and magnitude priors is proposed to regularize the reconstruction (PAIR).

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!