Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Deep spectral reflectance and illuminant estimation from self-interreflections

Not Accessible

Your library or personal account may give you access

Abstract

In this work, we propose a convolutional neural network based approach to estimate the spectral reflectance of a surface and spectral power distribution of light from a single RGB image of a V-shaped surface. Interreflections happening in a concave surface lead to gradients of RGB values over its area. These gradients carry a lot of information concerning the physical properties of the surface and the illuminant. Our network is trained with only simulated data constructed using a physics-based interreflection model. Coupling interreflection effects with deep learning helps to retrieve the spectral reflectance under an unknown light and to estimate spectral power distribution of this light as well. In addition, it is more robust to the presence of image noise than classical approaches. Our results show that the proposed approach outperforms state-of-the-art learning-based approaches on simulated data. In addition, it gives better results on real data compared to other interreflection-based approaches.

© 2018 Optical Society of America

Full Article  |  PDF Article
More Like This
Spectral reflectance estimation from one RGB image using self-interreflections in a concave object

Rada Deeb, Damien Muselet, Mathieu Hebert, and Alain Trémeau
Appl. Opt. 57(17) 4918-4929 (2018)

Variational approach to interreflection in color images

Mark S. Drew and Brian V. Funt
J. Opt. Soc. Am. A 9(8) 1255-1265 (1992)

Improving RGB illuminant estimation exploiting spectral average radiance

Ilaria Erba, Marco Buzzelli, Jean-Baptiste Thomas, Jon Yngve Hardeberg, and Raimondo Schettini
J. Opt. Soc. Am. A 41(3) 516-526 (2024)

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (4)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (5)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (25)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All Rights Reserved