Abstract

An optical–electronic hybrid convolutional neural network (CNN) system is proposed and investigated for its parallel processing capability and system design robustness. It is regarded as a practical way to implement real-time optical computing. In this paper, we propose a complex-valued modulation method based on an amplitude-only liquid-crystal-on-silicon spatial light modulator and a fixed four-level diffractive optical element. A comparison of computational results of convolutions between different modulation methods in the Fourier plane shows the feasibility of the proposed complex-valued modulation method. A hybrid CNN model with one convolutional layer of multiple channels is proposed and trained electrically for different classification tasks. Our simulation results show that this model has a classification accuracy of 97.55% for MNIST, 88.81% for Fashion MNIST, and 56.16% for Cifar10, which outperforms models using only amplitude or phase modulation and is comparable to the ideal complex-valued modulation method.

© 2023 Optica Publishing Group

OP-FCNN: an optronic fully convolutional neural network for imaging through scattering media

Zicheng Huang, Ziyu Gu, Mengyang Shi, Yesheng Gao, and Xingzhao Liu
Opt. Express 32(1) 444-456 (2024)

Optronic convolutional neural networks of multi-layers with different functions executed in optics for image classification

Ziyu Gu, Yesheng Gao, and Xingzhao Liu
Opt. Express 29(4) 5877-5889 (2021)

Massively parallel amplitude-only Fourier neural network

Mario Miscuglio, Zibo Hu, Shurui Li, Jonathan K. George, Roberto Capanna, Hamed Dalir, Philippe M. Bardet, Puneet Gupta, and Volker J. Sorger
Optica 7(12) 1812-1819 (2020)

Knowledge distillation circumvents nonlinearity for optical convolutional neural networks

Jinlin Xiang, Shane Colburn, Arka Majumdar, and Eli Shlizerman
Appl. Opt. 61(9) 2173-2183 (2022)

Optical frontend for a convolutional neural network

Shane Colburn, Yi Chu, Eli Shilzerman, and Arka Majumdar
Appl. Opt. 58(12) 3179-3186 (2019)