Abstract

Lensless cameras are characterized by several advantages (e.g., miniaturization, ease of manufacture, and low cost) as compared with conventional cameras. However, they have not been extensively employed due to their poor image clarity and low image resolution, especially for tasks that have high requirements on image quality and details such as text detection and text recognition. To address the problem, a framework of deep-learning-based pipeline structure was built to recognize text with three steps from raw data captured by employing lensless cameras. This pipeline structure consisted of the lensless imaging model U-Net, the text detection model connectionist text proposal network (CTPN), and the text recognition model convolutional recurrent neural network (CRNN). Compared with the method focusing only on image reconstruction, U-Net in the pipeline was able to supplement the imaging details by enhancing factors related to character categories in the reconstruction process, so the textual information can be more effectively detected and recognized by CTPN and CRNN with fewer artifacts and high-clarity reconstructed lensless images. By performing experiments on datasets of different complexities, the applicability to text detection and recognition on lensless cameras was verified. This study reasonably demonstrates text detection and recognition tasks in the lensless camera system, and develops a basic method for novel applications.

© 2022 Optica Publishing Group

Hand gestures recognition in videos taken with a lensless camera

Yinger Zhang, Zhouyi Wu, Peiying Lin, Yang Pan, Yuting Wu, Liufang Zhang, and Jiangtao Huangfu
Opt. Express 30(22) 39520-39533 (2022)

Lensless facial recognition with encrypted optics and a neural network computation

Ming-Hsuan Wu, Ya-Ti Chang Lee, and Chung-Hao Tien
Appl. Opt. 61(26) 7595-7601 (2022)

Underwater optical signal detection system using diffuser-based lensless imaging

Yinuo Huang, Gokul Krishnan, Saurabh Goswami, and Bahram Javidi
Opt. Express 32(2) 1489-1500 (2024)

Incoherent reconstruction-free object recognition with mask-based lensless optics and the Transformer

Xiuxi Pan, Xiao Chen, Tomoya Nakamura, and Masahiro Yamaguchi
Opt. Express 29(23) 37962-37978 (2021)

Learned lensless 3D camera

Feng Tian and Weijian Yang
Opt. Express 30(19) 34479-34496 (2022)