Abstract

Learning three-dimensional (3D) shape representation of an object from a single-shot image has been a prevailing topic in computer vision and deep learning over the past few years. Despite extensive adoption in dynamic applications, the measurement accuracy of the 3D shape acquisition from a single-shot image is still unsatisfactory due to a wide range of challenges. We present an accurate 3D shape acquisition method from a single-shot two-dimensional (2D) image using the integration of a structured-light technique and a deep learning approach. Instead of a direct 2D-to-3D transformation, a pattern-to-pattern network is trained to convert a single-color structured-light image to multiple dual-frequency phase-shifted fringe patterns for succeeding 3D shape reconstructions. Fringe projection profilometry, a prominent structured-light technique, is employed to produce high-quality ground-truth labels for training the network and to accomplish the 3D shape reconstruction after predicting the fringe patterns. A series of experiments has been conducted to demonstrate the practicality and potential of the proposed technique for scientific research and industrial applications.

© 2022 Optica Publishing Group

Different structured-light patterns in single-shot 2D-to-3D image conversion using deep learning

Andrew-Hieu Nguyen, Brian Sun, Charlotte Qiong Li, and Zhaoyang Wang
Appl. Opt. 61(34) 10105-10115 (2022)

Composite fringe projection deep learning profilometry for single-shot absolute 3D shape measurement

Yixuan Li, Jiaming Qian, Shijie Feng, Qian Chen, and Chao Zuo
Opt. Express 30(3) 3424-3442 (2022)

MIMONet: Structured-light 3D shape reconstruction by a multi-input multi-output network

Hieu Nguyen, Khanh L. Ly, Thanh Nguyen, Yuzheng Wang, and Zhaoyang Wang
Appl. Opt. 60(17) 5134-5144 (2021)

Single-shot 3D shape measurement using an end-to-end stereo matching network for speckle projection profilometry

Wei Yin, Yan Hu, Shijie Feng, Lei Huang, Qian Kemao, Qian Chen, and Chao Zuo
Opt. Express 29(9) 13388-13407 (2021)

Deep learning-based Phase Measuring Deflectometry for single-shot 3D shape measurement and defect detection of specular objects

Luyao Fan, Zhaoxing Wu, Jie Wang, Chen Wei, Huimin Yue, and Yong Liu
Opt. Express 30(15) 26504-26518 (2022)