Abstract

In stereo-matching techniques for three-dimensional (3D) vision, illumination change is a major problem that degrades matching accuracy. When large intensity differences are observed between a pair of stereos, it is difficult to find the similarity in the matching process. In addition, inaccurately estimated disparities are obtained in textureless regions, since there are no distinguishable features in the region. To solve these problems, this paper presents a robust stereo-matching method using illuminant-invariant cost volume and confidence-based disparity refinement. In the step of matching a stereo pair, the proposed method combines two cost volumes using an invariant image and Weber local descriptor (WLD), which was originally motivated by human visual characteristics. The invariant image used in the matching step is insensitive to sudden brightness changes by shadow or light sources, and WLD reflects structural features of the invariant image with consideration of a gradual illumination change. After aggregating the cost using a guided filter, we refine the initially estimated disparity map based on the confidence map computed by the combined cost volume. Experimental results verify that the matching computation of the proposed method improves the accuracy of the disparity map under a radiometrically dynamic environment. Since the proposed disparity refinement method can also reduce the error of the initial disparity map in textureless areas, it can be applied to various 3D vision systems such as industrial robots and autonomous vehicles.

© 2019 Optical Society of America

Disparity-selective stereo matching using correlation confidence measure

Sijung Kim, Jinbeum Jang, Jaeseung Lim, Joonki Paik, and Sangkeun Lee
J. Opt. Soc. Am. A 35(9) 1653-1662 (2018)

Stereo matching based on multi-scale fusion and multi-type support regions

Haibin Li, Yakun Gao, Ziyue Huang, and Yakun Zhang
J. Opt. Soc. Am. A 36(9) 1523-1533 (2019)

Occlusion disparity refinement for stereo matching through the geometric prior-based adaptive label search

Junwei Wang, Wei Zhou, Ziheng Qian, Jiaqi Shen, and Hanming Guo
J. Opt. Soc. Am. A 38(11) 1619-1630 (2021)

Adaptive epipolar distance transform and adaptive matching cost for stereo matching

Yakun Zhang, Haibin Li, and Wenming Zhang
J. Opt. Soc. Am. A 38(8) 1170-1177 (2021)

Multi-brightness layers with a genetic optimization algorithm for stereo matching under dramatic illumination changes

Tao Yang, Rui Yang, and Yuehong Qiu
Appl. Opt. 60(24) 7371-7380 (2021)