Non-line-of-sight (NLOS) imaging has the ability to reconstruct hidden objects from indirect light paths that scatter multiple times in the surrounding environment, which is of considerable interest in a wide range of applications. Whereas conventional imaging involves direct line-of-sight light transport to recover the visible objects, NLOS imaging aims to reconstruct the hidden objects from the indirect light paths that scatter multiple times, typically using the information encoded in the time-of-flight of scattered photons. Despite recent advances, NLOS imaging has remained at short-range realizations, limited by the heavy loss and the spatial mixing due to the multiple diffuse reflections. Here, both experimental and conceptual innovations yield hardware and software solutions to increase the standoff distance of NLOS imaging from meter to kilometer range, which is about three orders of magnitude longer than previous experiments. In hardware, we develop a high-efficiency, low-noise NLOS imaging system at near-infrared wavelength based on a dual-telescope confocal optical design. In software, we adopt a convex optimizer, equipped with a tailored spatial-temporal kernel expressed using three-dimensional matrix, to mitigate the effect of the spatial-temporal broadening over long standoffs. Together, these enable our demonstration of NLOS imaging and real-time tracking of hidden objects over a distance of 1.43 km. The results will open venues for the development of NLOS imaging techniques and relevant applications to real-world conditions.
Download full-text PDF |
Source |
---|---|
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7958383 | PMC |
http://dx.doi.org/10.1073/pnas.2024468118 | DOI Listing |
Nanophotonics
May 2024
National Key Laboratory of Optical Filed Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China.
Non-line-of-sight (NLOS) imaging aims at recovering hidden objects located beyond the traditional line of sight, with potential applications in areas such as security monitoring, search and rescue, and autonomous driving. Conventionally, NLOS imaging requires raster scanning of laser pulses and collecting the reflected photons from a relay wall. High-time-resolution detectors obtain the flight time of photons undergoing multiple scattering for image reconstruction.
View Article and Find Full Text PDFJ Imaging
October 2024
College of Automation & Information Engineering, Xi'an University of Technology, Xi'an 710048, China.
In this paper, a semantic communication-based scheme was proposed to tackle the optimization challenge of transmission efficiency and link stability in indoor visible light communication (VLC) systems utilizing light-emitting diodes for image transmission. The semantic model, established by deep convolutional generative adversarial network (DCGAN) and vector quantization method, can effectively extract the essential characteristics of images. In addition, indoor VLC channel models including line-of-sight (LOS) and non-line-of-sight (NLOS) links are established in a 5*5*3 room, while incorporating noise interference encountered during signal transmission into the training process of the semantic model to enhance its anti-interference capability.
View Article and Find Full Text PDFWith the rapid development of the Internet of Things, location-based services are becoming increasingly important, especially in indoor environments. Visible light positioning (VLP) has garnered widespread attention due to its high accuracy, low cost, and immunity to the radio frequency electromagnetic interference. However, traditional VLP relies on line-of-sight paths, making it impractical in complex and dynamic indoor environments.
View Article and Find Full Text PDFNat Comput Sci
December 2024
Hefei National Research Center for Physical Sciences at the Microscale and School of Physical Sciences, University of Science and Technology of China, Hefei, China.
Non-line-of-sight (NLOS) imaging aims at recovering the shape and albedo of hidden objects. Despite recent advances, real-time video of complex and dynamic scenes remains a major challenge owing to the weak signal of multiply scattered light. Here we propose and demonstrate a framework of spectrum filtering and motion compensation to realize high-quality NLOS video for room-sized scenes.
View Article and Find Full Text PDFEnter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!