Abstract

We present a new training-out algorithm for neural networks that permits good performance on nonideal hardware with limited analog neuron and weight accuracy. Optical neural networks are emphasized with the error sources including nonuniform beam illumination and nonlinear device characteristics. We compensate for processor nonidealities during gated learning (off-line training); thus our algorithm does not require real-time neural networks with adaptive weights. This permits use of high-accuracy nonadaptive weights and reduced hardware complexity. The specific neural network we consider is the Ho–Kashyap associative processor because it provides the largest storage capacity. Simulation results and optical laboratory data are provided. The storage measure we use is the ratio M/N of the number of vectors stored (M) to the dimensionality of the vectors stored (N). We show a storage capacity of M/N = 1.5 on our optical laboratory system with excellent recall accuracy, >95%. The theoretical maximum storage is M/N = 2 (as N approaches infinity), and thus the storage and performance we demonstrate are impressive considering the processor nonidealities we present. Our techniques can be applied to other neural network algorithms and other nonideal processing hardware.

© 1994 Optical Society of America

Electronic hardware implementations of neural networks

A. P. Thakoor, A. Moopenn, John Lambe, and S. K. Khanna
Appl. Opt. 26(23) 5085-5092 (1987)

Optical neural network with quantum well devices

Andrew Jennings, Paul Horan, and John Hegarty
Appl. Opt. 33(8) 1469-1476 (1994)

Four-quadrant optical matrix–vector multiplication machine as a neural-network processor

S. Abramson, D. Saad, E. Marom, and N. Konforti
Appl. Opt. 32(8) 1330-1337 (1993)

Reversal-input superposing technique for all-optical neural networks

Yoshio Hayasaki, Ichiro Tohyama, Toyohiko Yatagai, Masahiko Mori, and Satoshi Ishihara
Appl. Opt. 33(8) 1477-1484 (1994)

Optical implementation of a translation-invariant second-order neural network for multiple-pattern classification

Sunao Kakizaki, Paul Horan, Akira Arimoto, Hiroshi Sako, Atsushi Saito, and Fumio Kugiya
Appl. Opt. 33(35) 8270-8280 (1994)