Abstract

Convolution neural network (CNN), as one of the most powerful and popular technologies, has achieved remarkable progress for image and video classification since its invention. However, with the high definition video-data explosion, convolution layers in the CNN architecture will occupy a great amount of computing time and memory resources due to high computation complexity of matrix multiply accumulate operation. In this paper, a novel integrated photonic CNN is proposed based on double correlation operations through interleaved time-wavelength modulation. Micro-ring based multi-wavelength manipulation and single dispersion medium are utilized to realize convolution operation and replace the conventional optical delay lines. 200 images are tested in MNIST datasets with accuracy of 85.5 $\%$ in our photonic CNN versus 86.5 $\%$ in 64-bit computer. We also analyze the computing error of photonic CNN caused by various micro-ring parameters, operation baud rates and the characteristics of micro-ring weighting bank. Furthermore, a tensor processing unit based on 4×4 mesh with 1.2 Tera operation per second (TOPS) computing capability at 20 G baud rate is proposed and analyzed to form a paralleled photonic CNN.

Photonics-enabled spiking timing-dependent convolutional neural network for real-time image classification

Xiangyan Meng, Nuannuan Shi, Difei Shi, Wei Li, and Ming Li
Opt. Express 30(10) 16217-16228 (2022)

Implementation of energy-efficient convolutional neural networks based on kernel-pruned silicon photonics

Duan Huang, YanTing Xiong, Zhuangzhuang Xing, and Qi Zhang
Opt. Express 31(16) 25865-25880 (2023)

Photonic convolutional neural network with robustness against wavelength deviations

Kaifei Tang, Xiang Ji, Jiahui Liu, Jiantao Wang, Yu Xin, Jizhou Liu, Guihan Wu, Qi Sun, Zhaobang Zeng, Rulei Xiao, Nicholas Madamopoulos, Xiangfei Chen, and Wei Jiang
Opt. Express 31(23) 37348-37364 (2023)

High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays

Shaofu Xu, Jing Wang, Rui Wang, Jiangping Chen, and Weiwen Zou
Opt. Express 27(14) 19778-19787 (2019)

Optical patching scheme for optical convolutional neural networks based on wavelength-division multiplexing and optical delay lines

Shaofu Xu, Jing Wang, and Weiwen Zou
Opt. Lett. 45(13) 3689-3692 (2020)