Snapshot multispectral imaging using a diffractive optical network.

Light Sci Appl

Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA.

Published: April 2023

Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal-plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72λ, where λ is the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially repeating virtual spectral filter array with 2 × 2 = 4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10079962PMC
http://dx.doi.org/10.1038/s41377-023-01135-0DOI Listing

Publication Analysis

Top Keywords

multispectral imaging
20
diffractive multispectral
16
multispectral imager
12
diffractive
9
multispectral
9
snapshot multispectral
8
diffractive optical
8
virtual spectral
8
spectral filter
8
filter array
8

Similar Publications

Purpose: This study explores the potential interaction of brolucizumab with platelets and its effects on platelet activation and reactivity, crucial in retinal vasculitis and retinal vascular occlusion. Safety concerns remain of interest, although brolucizumab showed superior retinal efficacy and reduced injection frequency compared to other licensed anti-VEGF agents.

Methods: Resting and activated platelets of healthy volunteers were pretreated with brolucizumab at the following concentrations 0.

View Article and Find Full Text PDF

Assessment of the effect of management activities like a drought salinity barrier and herbicide treatments on the spread of submersed and floating aquatic estuary macrophytes.

Sci Total Environ

January 2025

Center for Spatial Technologies and Remote Sensing (CSTARS), Institute of the Environment, University of California, One Shields Avenue, Davis, CA 95616, USA. Electronic address:

Estuaries are complex ecosystems, being difficult to determine the way management actions affect them. This study quantitatively evaluated the spread of invasive submerged and floating aquatic macrophyte vegetation in Franks Tract of the Sacramento-San Joaquin Delta in response to two types of management actions, drought salinity barriers in years 2015, 2021 and 2022, and herbicide treatments in years 2004-2022. A Random Forest algorithm applied to airborne hyperspectral and satellite multispectral images generated maps of macrophyte cover in 2004-2022.

View Article and Find Full Text PDF

In this study, we explore an enhancement to the U-Net architecture by integrating SK-ResNeXt as the encoder for Land Cover Classification (LCC) tasks using Multispectral Imaging (MSI). SK-ResNeXt introduces cardinality and adaptive kernel sizes, allowing U-Net to better capture multi-scale features and adjust more effectively to variations in spatial resolution, thereby enhancing the model's ability to segment complex land cover types. We evaluate this approach using the Five-Billion-Pixels dataset, composed of 150 large-scale RGB-NIR images and over 5 billion labeled pixels across 24 categories.

View Article and Find Full Text PDF

Magnesium plays an important role in the hardening mechanism of aluminum alloys, but sensitisation-induced intergranular corrosion cracking limits the widespread use of aluminum alloy in equipment. For on-site quantitative assessment of sensitisation in 5-series aluminum alloys, a laser-induced plasma imaging technique is proposed, which evaluates the degree of aluminum alloy sensitisation by obtaining images of the plasma formed by laser ablation of aluminum alloys, and then classifying and quantifying the images using a residual network. Compared to EMAT, XRD, ECT and LIBS techniques, the sample surface only needs to be polished, does not consume chemical reagents and is not affected by the shape and thickness of the workpiece, which provides higher quantitative accuracy, stability and detection efficiency.

View Article and Find Full Text PDF

Multispectral Integrated Black Arsenene Phototransistors for High-Resolution Imaging and Enhanced Secure Communication.

ACS Nano

December 2024

State Key Laboratory of Infrared Physics, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, 500 Yu-Tian Road, Shanghai 200083, China.

The demand for broadband, room-temperature infrared, and terahertz (THz) detectors is rapidly increasing owing to crucial applications in telecommunications, security screening, nondestructive testing, and medical diagnostics. Current photodetectors face significant challenges, including high intrinsic dark currents and the necessity for cryogenic cooling, which limit their effectiveness in detecting low-energy photons. Here, we introduce a high-performance ultrabroadband photodetector operating at room temperature based on two-dimensional black arsenene (b-As) nanosheets.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!