Abstract

We implement faithful multimode fiber (MMF) image transmission by a self-attention-based neural network. Compared with a real-valued artificial neural network (ANN) based on a convolutional neural network (CNN), our method utilizes a self-attention mechanism to achieve a higher image quality. The enhancement measure (EME) and structural similarity (SSIM) of the dataset collected in the experiment improved by 0.79 and 0.04; the total number of parameters can be reduced by up to 25%. To enhance the robustness of the neural network to MMF bending in image transmission, we use a simulation dataset to prove that the hybrid training method is helpful in MMF transmission of a high-definition image. Our findings may pave the way for simpler and more robust single-MMF image transmission schemes with hybrid training; SSIM on datasets under different disturbances improve by 0.18. This system has the potential to be applied to various high-demand image transmission tasks, such as endoscopy.

© 2023 Optica Publishing Group

Super-resolution multimode fiber imaging with an untrained neural network

Wei Li, Ksenia Abrashitova, and Lyubov V. Amitonova
Opt. Lett. 48(13) 3363-3366 (2023)

Deep learning for efficiently imaging through the localized speckle field of a multimode fiber

Yongcheng Chen, Binbin Song, Jixuan Wu, Wei Lin, and Wei Huang
Appl. Opt. 62(2) 266-274 (2023)

Deep learning image transmission through a multimode fiber based on a small training dataset

Binbin Song, Chang Jin, Jixuan Wu, Wei Lin, Bo Liu, Wei Huang, and Shengyong Chen
Opt. Express 30(4) 5657-5672 (2022)

Attention-based neural network for polarimetric image denoising

Hedong Liu, Yizhu Zhang, Zhenzhou Cheng, Jingsheng Zhai, and Haofeng Hu
Opt. Lett. 47(11) 2726-2729 (2022)

Multimode fiber-based greyscale image projector enabled by neural networks with high generalization ability

Jian Wang, Guangchao Zhong, Daixuan Wu, Sitong Huang, Zhi-Chao Luo, and Yuecheng Shen
Opt. Express 31(3) 4839-4850 (2023)