Abstract

This study proposes a portrait image relighting system based on a simplified photometric stereo method. The system, comprising a controllable digital single lens reflex camera and five polarized flashlights, can obtain a color shade-less image and synthesize a normal map from shaded images. When calibrating the photometric stereo, the normal map is taken as a linear combination of shaded images and clamped with respect to specific normal directions on a white-coated sphere. The relit images were generated through inverse rendering in a predefined virtual environment. To evaluate personal preference, 24 adult subjects were recruited to conduct subjective assessments comparing the deep portrait relighting method results. From experiments regarding different scenarios, we concluded that the proposed system based on a simplified photometric stereo performs acceptably for relighting portrait images.

© 2022 Optica Publishing Group

Real-time relighting of digital holograms based on wavefront recording plane method

P.W.M. Tsang, K.W.K. Cheung, and T.-C Poon
Opt. Express 20(6) 5962-5967 (2012)

Multimodal endoscopic system based on multispectral and photometric stereo imaging and analysis

Jihun Kim, Hasan Al Faruque, Sewoong Kim, Eunjoo Kim, and Jae Youn Hwang
Biomed. Opt. Express 10(5) 2289-2302 (2019)

Hyperspectral photometric stereo for a single capture

Keisuke Ozawa, Imari Sato, and Masahiro Yamaguchi
J. Opt. Soc. Am. A 34(3) 384-394 (2017)

Photometric invariant stereo matching method

Feifei Gu, Hong Zhao, Xiang Zhou, Jinjun Li, Penghui Bu, and Zixin Zhao
Opt. Express 23(25) 31779-31792 (2015)

Continuous material reflectance map for deep photometric stereo

Nicolas Prouteau, Clément Joubert, Benjamin Bringier, and Majdi Khoudeir
J. Opt. Soc. Am. A 40(4) 792-802 (2023)