Abstract

The imaging process of the light field (LF) camera with a micro-lens array (MLA) may suffer from multiple aberrations. It is thus difficult to precisely calibrate the intrinsic hardware parameters and calculate the corresponding point spread function (PSF). To build an aberration-aware solution with better generalization, we propose an end-to-end imaging model based on the differentiable ray tracing. The input end is the point source location, and the output end is the rendered LF image, namely, PSF. Specially, a projection method is incorporated into the imaging model, eliminating the huge memory overhead induced by a large array of periodic elements. Taking captured PSF images as the ground truth, the LF camera is calibrated with the genetic algorithm initially and then the gradient-based optimization. This method is promising to be used in various LF camera applications, especially in challenging imaging conditions with severe aberrations.

© 2024 Optica Publishing Group

Point spread function for the wide-field-of-view plenoptic cameras

Xin Jin, Kunyi Li, Chuanpu Li, and Xufu Sun
Opt. Express 29(15) 23764-23776 (2021)

Computational simulation of multi-wavelength light-field thermometry based on a chromatic meta-lens

Yulun He, Shengxian Shi, Chunhui Yao, Zhou Zhao, Mu Ku Chen, and Fei Qi
Opt. Lett. 49(4) 961-964 (2024)

Point spread function for diffuser cameras based on wave propagation and projection model

Xin Jin, David Mao San Wei, and Qionghai Dai
Opt. Express 27(9) 12748-12761 (2019)

Holistic calibration method of deflectometry by holonomic framework priors

Wei Lang, Xiangchao Zhang, Yunuo Chen, Ting Chen, and Xiangqian Jiang
Opt. Lett. 49(3) 702-705 (2024)

Calibration of transverse ray and pupil aberrations for light field cameras

Elliott Kwan and Hong Hua
Appl. Opt. 61(24) 6974-6984 (2022)