Abstract

Machine Learning (ML) algorithms have shown to complement standard digital signal processing (DSP) tools in mitigating fiber nonlinearity and improving long-haul transmission performance. However, dynamic transmission impairments such as polarization effects and carrier phase noise corrupt the training data and conventional cost functions for neural network (NN) training become unsuitable. Simple cascade of ML and standard adaptive DSP blocks will also result in suboptimal transmission performance or require impractical training methodologies in presence of such dynamic transmission impairments. We show how the adaptive DSP blocks can be treated as extra stateful NN layers and be combined with the main NN so that standard backpropagation-like training algorithms in ML can be applied. In this case, the adaptive filters are viewed as NN states which are updated in the forward pass of the backpropagation. We study the combined training of linear and nonlinear parameters in the digital backpropagation (DBP) algorithm for fiber nonlinearity compensation (named generalized DBP (GDBP) hereafter), residual impairments, polarization effects, frequency offsets and carrier phase noise compensation filters as a single NN in a 7 × 288 Gb/s polarization multiplexed (PM)-16QAM transmission experiment over 1125 km. We derived the complete set of backpropagation-like gradients and state update equations for the static and dynamic parameters of the combined NN. We further proposed and open-sourced a JAX-based coding framework for their easy and practical implementation. GDBP is more generalized than other DBP variants proposed in literature and for a given total number of steps, GDBP is the first experimental demonstration of optimal single-channel DBP based-fiber nonlinearity compensation algorithm. In addition, for complexity constrained situations with shortened filter taps, GDBP enables a 1 dB performance improvement over other DBP variants.

Design of fully interpretable neural networks for digital coherent demodulation

Xiatao Huang, Wenshan Jiang, Xingwen Yi, Jing Zhang, Taowei Jin, Qianwu Zhang, Bo Xu, and Kun Qiu
Opt. Express 30(20) 35526-35538 (2022)

Equalization performance and complexity analysis of dynamic deep neural networks in long haul transmission systems

Oleg Sidelnikov, Alexey Redyuk, and Stylianos Sygletos
Opt. Express 26(25) 32765-32776 (2018)

Deep learning based digital backpropagation demonstrating SNR gain at low complexity in a 1200 km transmission link

Bertold Ian Bitachon, Amirhossein Ghazisaeidi, Marco Eppenberger, Benedikt Baeuerle, Masafumi Ayata, and Juerg Leuthold
Opt. Express 28(20) 29318-29334 (2020)

On the performance of multichannel digital backpropagation in high-capacity long-haul optical transmission

Gabriele Liga, Tianhua Xu, Alex Alvarado, Robert I. Killey, and Polina Bayvel
Opt. Express 22(24) 30053-30062 (2014)

Joint intra and inter-channel nonlinearity compensation based on interpretable neural network for long-haul coherent systems

Du Tang, Zhen Wu, Zhongliang Sun, Xizi Tang, and Yaojun Qiao
Opt. Express 29(22) 36242-36256 (2021)