Abstract

Holographic display is considered as a promising three-dimensional (3D) display technology and has been widely studied. However, to date, the real-time holographic display for real scenes is still far from being incorporated in our life. The speed and quality of information extraction and holographic computing need to be further improved. In this paper, we propose an end-to-end real-time holographic display based on real-time capture of real scenes, where the parallax images are collected from the scene and a convolutional neural network (CNN) builds the mapping from the parallax images to the hologram. Parallax images are acquired in real time by a binocular camera, and contain depth information and amplitude information needed for 3D hologram calculation. The CNN, which can transform parallax images into 3D holograms, is trained by datasets consisting of parallax images and high-quality 3D holograms. The static colorful reconstruction and speckle-free real-time holographic display based on real-time capture of real scenes have been verified by the optical experiments. With simple system composition and affordable hardware requirements, the proposed technique will break the dilemma of the existing real-scene holographic display, and open up a new direction for the application of real-scene holographic 3D display such as holographic live video and solving vergence-accommodation conflict (VAC) problems for head-mounted display devices.

© 2023 Optica Publishing Group

From picture to 3D hologram: end-to-end learning of real-time 3D photorealistic hologram generation from 2D image input

Chenliang Chang, Bo Dai, Dongchen Zhu, Jiamao Li, Jun Xia, Dawei Zhang, Lianping Hou, and Songlin Zhuang
Opt. Lett. 48(4) 851-854 (2023)

Investigating learning-empowered hologram generation for holographic displays with ill-tuned hardware

Xinxing Xia, Furong Yang, Weisen Wang, Xinghua Shui, Frank Guan, Huadong Zheng, Yingjie Yu, and Yifan Peng
Opt. Lett. 48(6) 1478-1481 (2023)

Fourier-inspired neural module for real-time and high-fidelity computer-generated holography

Zhenxing Dong, Chao Xu, Yuye Ling, Yan Li, and Yikai Su
Opt. Lett. 48(3) 759-762 (2023)

Asymmetrical neural network for real-time and high-quality computer-generated holography

Guangwei Yu, Jun Wang, Huan Yang, Zicheng Guo, and Yang Wu
Opt. Lett. 48(20) 5351-5354 (2023)

Synthesis and display of dynamic holographic 3D scenes with real-world objects

Melania Paturzo, Pasquale Memmolo, Andrea Finizio, Risto Näsänen, Thomas J. Naughton, and Pietro Ferraro
Opt. Express 18(9) 8806-8815 (2010)