Abstract

We propose a passive three-dimensional (3D) imaging technique based on integral imaging using a long-wave infrared (LWIR) camera. 3D imaging can improve visualization and detection of objects in adverse environments, such as low light levels and the presence of partial occlusions, along with depth estimation by reconstructing the scene at the plane of the object. This is achieved by capturing multiple two-dimensional images, known as elemental images (EI), of a scene with each image having a unique perspective of the 3D objects. Moreover, LWIR imaging performs well in photon-limited environments due to detection of thermal radiation from an object rather than the reflected light. Once the EIs have been captured, image restoration is performed on the captured images. A 3D scene is then reconstructed and object detection using correlation filters and support vector machines is performed. Our experiments with human face detection show that 2D imaging may fail to detect occluded humans, whereas passive 3D imaging with LWIR could be successful. To the best of our knowledge, this is the first report of passive 3D integral imaging with LWIR for object detection, and in particular, in low light environments.

© 2017 Optical Society of America

Three-dimensional profilometric reconstruction using flexible sensing integral imaging and occlusion removal

Xin Shen, Adam Markman, and Bahram Javidi
Appl. Opt. 56(9) D151-D157 (2017)

3D object detection through fog and occlusion: passive integral imaging vs active (LiDAR) sensing

Kashif Usmani, Timothy O’Connor, Pranav Wani, and Bahram Javidi
Opt. Express 31(1) 479-491 (2023)

Lowlight object recognition by deep learning with passive three-dimensional integral imaging in visible and long wave infrared wavelengths

Pranav Wani, Kashif Usmani, Gokul Krishnan, Timothy O’Connor, and Bahram Javidi
Opt. Express 30(2) 1205-1218 (2022)

Three-dimensional polarimetric integral imaging in photon-starved conditions: performance comparison between visible and long wave infrared imaging

Kashif Usmani, Timothy O’Connor, Xin Shen, Pete Marasco, Artur Carnicer, Dipak Dey, and Bahram Javidi
Opt. Express 28(13) 19281-19294 (2020)

Deep learning polarimetric three-dimensional integral imaging object recognition in adverse environmental conditions

Kashif Usmani, Gokul Krishnan, Timothy O’Connor, and Bahram Javidi
Opt. Express 29(8) 12215-12228 (2021)