Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Recovery of geometry, natural illumination, and BRDF from a single light field image

Not Accessible

Your library or personal account may give you access

Abstract

We propose an inverse rendering model for light fields to recover surface normals, depth, reflectance, and natural illumination. Our setting is fully uncalibrated, with the reflectance modeled with a spatially constant Blinn–Phong bidirectional reflectance distribution function (BRDF) and illumination as an environment map. While previous work makes strong assumptions in this difficult scenario, focusing solely on specific types of objects such as faces or imposing very strong priors, our approach leverages only the light field structure, where a solution consistent across all subaperture views is sought. The optimization is based primarily on shading, which is sensitive to fine geometric details that are propagated to the initial coarse depth map. Despite the problem being inherently ill posed, we achieve encouraging results on synthetic as well as real-world data.

© 2021 Optical Society of America

Full Article  |  PDF Article
More Like This
Continuous material reflectance map for deep photometric stereo

Nicolas Prouteau, Clément Joubert, Benjamin Bringier, and Majdi Khoudeir
J. Opt. Soc. Am. A 40(4) 792-802 (2023)

Light-field-depth-estimation network based on epipolar geometry and image segmentation

Xucheng Wang, Chenning Tao, Rengmao Wu, Xiao Tao, Peng Sun, Yong Li, and Zhenrong Zheng
J. Opt. Soc. Am. A 37(7) 1236-1243 (2020)

Photography-based real-time long-wave infrared scattering estimation technique

Tianqi Luo, Di Lin, Merlin Mah, Connor Hashemi, James R. Leger, and Joseph J. Talghader
J. Opt. Soc. Am. A 38(7) 1041-1050 (2021)

Supplementary Material (4)

NameDescription
Visualization 1       The scene is re-rendered with a sliding illumination (left-top) ground truth scene (right-top) estimated re-rendered scene (left bottom) unit sphere with gt illumination and BRDF (right bottom) unit sphere coated with estimated BRDF and light.
Visualization 2       The scene is re-rendered with a sliding illumination (left-top) ground truth scene (right-top) estimated re-rendered scene (left bottom) unit sphere with gt illumination and BRDF (right bottom) unit sphere coated with estimated BRDF and light.
Visualization 3       The scene is re-rendered with a sliding illumination (left-top) ground truth scene (right-top) estimated re-rendered scene (left bottom) unit sphere with gt illumination and BRDF (right bottom) unit sphere coated with estimated BRDF and light.
Visualization 4       The scene is re-rendered with a sliding illumination (left-top) ground truth scene (right-top) estimated re-rendered scene (left bottom) unit sphere with gt illumination and BRDF (right bottom) unit sphere coated with estimated BRDF and light.

Data Availability

The data for Figs. 6, 7, 9, and 12 are available in [31].

31. A. Sulc, “IR-JOSAA,” GitHub (2021), https://github.com/sulcantonin/IR-JOSAA.git.

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (12)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (8)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All Rights Reserved