Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Optical random phase dropout in a diffractive deep neural network

Not Accessible

Your library or personal account may give you access

Abstract

Unitary learning is a backpropagation (BP) method that serves to update unitary weights in fully connected deep complex-valued neural networks, meeting a prior unitary in an active modulation diffractive deep neural network. However, the square matrix characteristic of unitary weights in each layer results in its learning belonging to a small-sample training, which produces an almost useless network that has a fairly poor generalization capability. To alleviate such a serious over-fitting problem, in this Letter, optical random phase dropout is formulated and designed. The equivalence between unitary forward and diffractive networks deduces a synthetic mask that is seamlessly compounded with a computational modulation and a random sampling comb called dropout. The dropout is filled with random phases in its zero positions that satisfy the Bernoulli distribution, which could slightly deflect parts of transmitted optical rays in each output end to generate statistical inference networks. The enhancement of generalization benefits from the fact that massively parallel full connection with different optical links is involved in the training. The random phase comb introduced into unitary BP is in the form of conjugation, which indicates the significance of optical BP.

© 2021 Optical Society of America

Full Article  |  PDF Article
More Like This
Optical random micro-phase-shift DropConnect in a diffractive deep neural network

Yong-Liang Xiao, Sikun Li, Guohai Situ, and Jianxin Zhong
Opt. Lett. 47(7) 1746-1749 (2022)

Orthogonality of diffractive deep neural network

Shuiqin Zheng, Shixiang Xu, and Dianyuan Fan
Opt. Lett. 47(7) 1798-1801 (2022)

Residual D2NN: training diffractive deep neural networks via learnable light shortcuts

Hongkun Dou, Yue Deng, Tao Yan, Huaqiang Wu, Xing Lin, and Qionghai Dai
Opt. Lett. 45(10) 2688-2691 (2020)

References

You do not have subscription access to this journal. Citation lists with outbound citation links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Data Availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Figures (8)

You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Equations (5)

You do not have subscription access to this journal. Equations are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.

Contact your librarian or system administrator
or
Login to access Optica Member Subscription

Metrics

Select as filters


Select Topics Cancel
© Copyright 2022 | Optica Publishing Group. All Rights Reserved