Abstract

Recent advancements in machine vision have enabled a great range of applications from image classification to autonomous driving. However, there is still a dilemma between the pursuit of higher-resolution training images that require a detector array with more pixels on the front end, and the demands on acquisition for embedded systems restrained by power, transmission bandwidth, and storage. In this paper, a multi-pixel hybrid optical convolutional neural network machine vision system was designed and validated to perform high-speed infrared object detection. The proposed system replicates the front convolution layer in a convolutional neural network utilizing a high-speed digital micro-mirror device to display the first layer of kernels at a resolution greater than the subsequent detector. After this, further convolutions are carried out in software to perform the object recognition. An infrared vehicle dataset was used to validate the performance of the hybrid system through simulation. We also tested this in hardware by performing infrared classification on toy vehicles to showcase the feasibility of such a design.

© 2021 Optical Society of America

Joint object classification and turbulence strength estimation using convolutional neural networks

Daniel A. LeMaster, Steven Leung, and Olga L. Mendoza-Schrock
Appl. Opt. 60(25) G40-G48 (2021)

Exo-atmospheric infrared objects classification using recurrence-plots-based convolutional neural networks

Qiuqun Deng, Huanzhang Lu, Moufa Hu, and Bendong Zhao
Appl. Opt. 58(1) 164-171 (2019)

Optronic convolutional neural networks of multi-layers with different functions executed in optics for image classification

Ziyu Gu, Yesheng Gao, and Xingzhao Liu
Opt. Express 29(4) 5877-5889 (2021)

Single-pixel neural network object classification of sub-Nyquist ghost imaging

Jia-Ning Cao, Yu-Hui Zuo, Hua-Hua Wang, Wei-Dong Feng, Zhi-Xin Yang, Jian Ma, Hao-Ran Du, Lu Gao, and Ze Zhang
Appl. Opt. 60(29) 9180-9187 (2021)

Optical frontend for a convolutional neural network

Shane Colburn, Yi Chu, Eli Shilzerman, and Arka Majumdar
Appl. Opt. 58(12) 3179-3186 (2019)