Abstract

We present a methodology for recovering the perspective imagery of a non-line-of-sight scene based on plenoptic observations of indirect photons scattered from a homogeneous surface. Our framework segregates the visual contents observed along the scattering surface into angular and spatial components. Given the reflectance characteristics of the scatterer, we show that the former can be deduced from scattering measurements employing diversity in angle at individual surface points, whereas the latter can be deduced from captured images of the scatterer based on prior knowledge of occlusions within the scene. We then combine the visual contents from both components into a plenoptic modality capable of imaging at higher resolutions than what is allowed by the angular information content and discriminating against extraneous signals in complex scenes that spatial information struggles to discern. We demonstrate the efficacy of this approach by reconstructing the imagery of test scenes from both synthetic and measured data.

© 2020 Optical Society of America

Locating non-line-of-sight features and recovering imagery conveyed through parallax in passive plenoptic imaging

Di Lin and James R. Leger
J. Opt. Soc. Am. A 38(8) 1104-1119 (2021)

Light field reconstruction from scattered light using plenoptic data

Takahiro Sasaki and James R. Leger
J. Opt. Soc. Am. A 37(4) 653-670 (2020)

Estimation of the 3D spatial location of non-line-of-sight objects using passive THz plenoptic measurements

Takahiro Sasaki, Erich N. Grossman, and James R. Leger
Opt. Express 30(23) 41911-41921 (2022)

Non-line-of-sight object location estimation from scattered light using plenoptic data

Takahiro Sasaki and James R. Leger
J. Opt. Soc. Am. A 38(2) 211-228 (2021)

Clutter rejection in passive non-line-of-sight imaging via blind multispectral unmixing

Connor Hashemi, Rafael Avelar, and James Leger
Opt. Express 32(2) 2132-2146 (2024)