Abstract

Color constancy is an essential component of the human visual system. It enables us to discern the color of objects invariant to the illumination that is present. This ability is difficult to reproduce in software, as the underlying problem is ill posed, i.e., for each pixel in the image, we know only the RGB values, which are a product of the spectral characteristics of the illumination and the reflectance of objects, as well as the sensitivity of the sensor. To combat this, additional assumptions about the scene have to be made. These assumptions can be either handcrafted or learned using some deep learning technique. Nonetheless, they mostly work only for single illuminant images. In this work, we propose a method for learning these assumptions for multi-illuminant scenes using an autoencoder trained to reconstruct the original image by splitting it into its illumination and reflectance components. We then show that the estimation can be used as is or can be used alongside a clustering method to create a segmentation map of illuminations. We show that our method performs the best out of all tested methods in multi-illuminant scenes while being completely invariant to the number of illuminants.

© 2022 Optica Publishing Group

Edge-moment-based color constancy using illumination-coherent regularized regression

Meng Wu, Kai Luo, Jianjun Dang, and Jun Zhou
J. Opt. Soc. Am. A 32(9) 1707-1716 (2015)

Object-based color constancy in a deep neural network

Hamed Heidari-Gorji and Karl R. Gegenfurtner
J. Opt. Soc. Am. A 40(3) A48-A56 (2023)

Iterative color constancy with temporal filtering for an image sequence with no relative motion between the camera and the scene

Josemar Simão, Hans Jörg Andreas Schneebeli, and Raquel Frizera Vassallo
J. Opt. Soc. Am. A 32(11) 2033-2043 (2015)

Nighttime color constancy using robust gray pixels

Cheng Cheng, Kai-Fu Yang, Xue-Mei Wan, Leanne Lai Hang Chan, and Yong-Jie Li
J. Opt. Soc. Am. A 41(3) 476-488 (2024)

Improving RGB illuminant estimation exploiting spectral average radiance

Ilaria Erba, Marco Buzzelli, Jean-Baptiste Thomas, Jon Yngve Hardeberg, and Raimondo Schettini
J. Opt. Soc. Am. A 41(3) 516-526 (2024)