Specular highlight removal based on an iterative light field method

Wei Feng; Xiuhua Li; Xingyu Sun; Junhui Gao; Tong Qu; Shoutong Wang; Daxing Zhao

doi:10.1364/AO.421433

Applied Optics
Vol. 60,
Issue 13,
pp. 4039-4046
(2021)
•https://doi.org/10.1364/AO.421433

Specular highlight removal based on an iterative light field method

Wei Feng, Xiuhua Li, Xingyu Sun, Junhui Gao, Tong Qu, Shoutong Wang, and Daxing Zhao

Not Accessible

Your library or personal account may give you access

Get PDF
Email
Share
Get Citation
Copy Citation Text
Wei Feng, Xiuhua Li, Xingyu Sun, Junhui Gao, Tong Qu, Shoutong Wang, and Daxing Zhao, "Specular highlight removal based on an iterative light field method," Appl. Opt. 60, 4039-4046 (2021)

Export Citation
- BibTex
- Endnote (RIS)
- HTML
- Plain Text
Citation alert
Save article

Check for updates

Abstract

In this paper, a novel, to the best of our knowledge, iterative approach for highlight removal is proposed using lenselet-based plenoptic cameras without multiple exposures. An unsupervised k-means clustering approach that relates unsaturated pixels to chromatic dispersion based on the intrinsic decomposition and dichromatic reflection model is proposed to recover unsaturated highlights. Meanwhile, an adaptive direction method along with a Gaussian probability distribution model is designed to recover the saturated highlights. Finally, a method that combines the specular residual ratio with information entropy is built to quantitatively evaluate the quality of highlight removal. Generally, our method not only fully removes specular highlights, but also has low spatial complexity of image acquisition, more stability, and outstanding restoration for complex scenes.

Full Article | PDF Article

More Like This

Real-time highlight removal using intensity ratio

Hui-Liang Shen and Zhi-Huan Zheng
Appl. Opt. 52(19) 4483-4493 (2013)

Simple and efficient method for specularity removal in an image

Hui-Liang Shen and Qing-Yuan Cai
Appl. Opt. 48(14) 2711-2719 (2009)

Optimization-based method removing highlights with flash/no-flash image

Jongwon Choi, Sangdoo Yun, and Jin Young Choi
Opt. Express 30(12) 20927-20942 (2022)

Previous Article Next Article

Data Availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (8)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Tables (2)

You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (16)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Step 1: Procedure Separation ( $I_{c}$ , $I_{4 d}$ )	▹ $I_{4 d}$ is the data of 4D light field
Initialize $L_{sc}$ , $I_{b}$ , $L_{ε}$	▹ $L_{sc}$ , $I_{b}$ are variables
Step 2: $I_{d}$ = Epi-Depth Estimation ( $I_{4 d}$ )	▹ $I_{d}$ is estimated depth
Step 3: $I_{r}$ = Intrinsic Decomposition ( $I_{c}$ )
$I_{b} = I_{c}$
Step 4: While $L_{sc} > L_{ε}$ do	▹ $L_{ε}$ is a threshold for specular detection
Saturation Judgment ( $L_{4 d}$ , $I_{d}$ )	▹ $L_{ua}$ is an unsaturated component while
$L_{s c} = L_{u a} + L_{a}$ ,	$L_{a}$ is saturated component
Step 5: ${\bar{I}}_{b} = U n s a t u r a t e d P i x e l P r o c e s s i n g$ ( $L_{u a}, I_{b}$ )	▹ Update 4D light-field data
$I_{4 d} = {\bar{I}}_{b}$
Step 6: $I_{b} = S a t u r a t e d P i x e l P r o c e s s i n g$ ( $L_{a}$ , $I_{b}$ )	▹ Update 4D light field data
$I_{4 d} = I_{b}$
Step 4: $L_{sc} = S p e c u l a r D e t e c t i o n$ ( $I_{b}$ )
End While
Return $I_{b}$ , $I_{4 d}$
End Procedure

Images	Ref. [16]	Ref. [13]	Ref. [14]	Our Method
Lego truck	5.08	5.14	4.49	6.20
Amethyst	4.35	5.19	4.55	6.07
Plant 1	3.95	5.56	4.23	6.66
Plant 2	4.80	4.91	4.01	6.70
Artifact 1	3.27	5.27	4.59	6.30
Artifact 2	2.60	4.67	0.00	6.67

Step 1: Procedure Separation ( $I_{c}$ , $I_{4 d}$ )	▹ $I_{4 d}$ is the data of 4D light field
Initialize $L_{sc}$ , $I_{b}$ , $L_{ε}$	▹ $L_{sc}$ , $I_{b}$ are variables
Step 2: $I_{d}$ = Epi-Depth Estimation ( $I_{4 d}$ )	▹ $I_{d}$ is estimated depth
Step 3: $I_{r}$ = Intrinsic Decomposition ( $I_{c}$ )
$I_{b} = I_{c}$
Step 4: While $L_{sc} > L_{ε}$ do	▹ $L_{ε}$ is a threshold for specular detection
Saturation Judgment ( $L_{4 d}$ , $I_{d}$ )	▹ $L_{ua}$ is an unsaturated component while
$L_{s c} = L_{u a} + L_{a}$ ,	$L_{a}$ is saturated component
Step 5: ${\bar{I}}_{b} = U n s a t u r a t e d P i x e l P r o c e s s i n g$ ( $L_{u a}, I_{b}$ )	▹ Update 4D light-field data
$I_{4 d} = {\bar{I}}_{b}$
Step 6: $I_{b} = S a t u r a t e d P i x e l P r o c e s s i n g$ ( $L_{a}$ , $I_{b}$ )	▹ Update 4D light field data
$I_{4 d} = I_{b}$
Step 4: $L_{sc} = S p e c u l a r D e t e c t i o n$ ( $I_{b}$ )
End While
Return $I_{b}$ , $I_{4 d}$
End Procedure

Images	Ref. [16]	Ref. [13]	Ref. [14]	Our Method
Lego truck	5.08	5.14	4.49	6.20
Amethyst	4.35	5.19	4.55	6.07
Plant 1	3.95	5.56	4.23	6.66
Plant 2	4.80	4.91	4.01	6.70
Artifact 1	3.27	5.27	4.59	6.30
Artifact 2	2.60	4.67	0.00	6.67

Abstract

Data Availability

Cited By

Figures (8)

Tables (2)

Equations (16)

Applied Optics