Non-line-of-sight imaging over 1.43 km.

Proc Natl Acad Sci U S A

Hefei National Laboratory for Physical Sciences at Microscale, University of Science and Technology of China, Hefei 230026, China;

Published: March 2021

Non-line-of-sight (NLOS) imaging has the ability to reconstruct hidden objects from indirect light paths that scatter multiple times in the surrounding environment, which is of considerable interest in a wide range of applications. Whereas conventional imaging involves direct line-of-sight light transport to recover the visible objects, NLOS imaging aims to reconstruct the hidden objects from the indirect light paths that scatter multiple times, typically using the information encoded in the time-of-flight of scattered photons. Despite recent advances, NLOS imaging has remained at short-range realizations, limited by the heavy loss and the spatial mixing due to the multiple diffuse reflections. Here, both experimental and conceptual innovations yield hardware and software solutions to increase the standoff distance of NLOS imaging from meter to kilometer range, which is about three orders of magnitude longer than previous experiments. In hardware, we develop a high-efficiency, low-noise NLOS imaging system at near-infrared wavelength based on a dual-telescope confocal optical design. In software, we adopt a convex optimizer, equipped with a tailored spatial-temporal kernel expressed using three-dimensional matrix, to mitigate the effect of the spatial-temporal broadening over long standoffs. Together, these enable our demonstration of NLOS imaging and real-time tracking of hidden objects over a distance of 1.43 km. The results will open venues for the development of NLOS imaging techniques and relevant applications to real-world conditions.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7958383PMC
http://dx.doi.org/10.1073/pnas.2024468118DOI Listing

Publication Analysis

Top Keywords

nlos imaging
28
hidden objects
12
imaging
8
reconstruct hidden
8
objects indirect
8
indirect light
8
light paths
8
paths scatter
8
scatter multiple
8
multiple times
8

Similar Publications

High-resolution non-line-of-sight imaging based on liquid crystal planar optical elements.

Nanophotonics

May 2024

National Key Laboratory of Optical Filed Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China.

Non-line-of-sight (NLOS) imaging aims at recovering hidden objects located beyond the traditional line of sight, with potential applications in areas such as security monitoring, search and rescue, and autonomous driving. Conventionally, NLOS imaging requires raster scanning of laser pulses and collecting the reflected photons from a relay wall. High-time-resolution detectors obtain the flight time of photons undergoing multiple scattering for image reconstruction.

View Article and Find Full Text PDF

Influence of Target Surface BRDF on Non-Line-of-Sight Imaging.

J Imaging

October 2024

College of Automation & Information Engineering, Xi'an University of Technology, Xi'an 710048, China.

Article Synopsis
  • * Using deep neural networks, the BRDF of different materials, like aluminized insulation and white paint board, was modeled and compared to traditional methods for accuracy.
  • * Results indicated that NLOS image quality improves with surfaces that have less specular reflection and more diffuse reflection, highlighting that the best clarity is achieved with high diffuse and no specular reflection surfaces.
View Article and Find Full Text PDF

In this paper, a semantic communication-based scheme was proposed to tackle the optimization challenge of transmission efficiency and link stability in indoor visible light communication (VLC) systems utilizing light-emitting diodes for image transmission. The semantic model, established by deep convolutional generative adversarial network (DCGAN) and vector quantization method, can effectively extract the essential characteristics of images. In addition, indoor VLC channel models including line-of-sight (LOS) and non-line-of-sight (NLOS) links are established in a 5*5*3 room, while incorporating noise interference encountered during signal transmission into the training process of the semantic model to enhance its anti-interference capability.

View Article and Find Full Text PDF

With the rapid development of the Internet of Things, location-based services are becoming increasingly important, especially in indoor environments. Visible light positioning (VLP) has garnered widespread attention due to its high accuracy, low cost, and immunity to the radio frequency electromagnetic interference. However, traditional VLP relies on line-of-sight paths, making it impractical in complex and dynamic indoor environments.

View Article and Find Full Text PDF

Real-time non-line-of-sight computational imaging using spectrum filtering and motion compensation.

Nat Comput Sci

December 2024

Hefei National Research Center for Physical Sciences at the Microscale and School of Physical Sciences, University of Science and Technology of China, Hefei, China.

Non-line-of-sight (NLOS) imaging aims at recovering the shape and albedo of hidden objects. Despite recent advances, real-time video of complex and dynamic scenes remains a major challenge owing to the weak signal of multiply scattered light. Here we propose and demonstrate a framework of spectrum filtering and motion compensation to realize high-quality NLOS video for room-sized scenes.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!