Abstract

In optical networks, reliable failure detection is essential for maintaining quality of service. The methodology has evolved from traditional performance threshold-driven approaches to contemporary data-driven AI algorithms, predominantly employing supervised and unsupervised learning. However, with the advent of second-level telemetry, optical transport networks have amassed a wealth of unlabeled performance data, while labeled data remains limited due to the intensive effort required for annotation. In this scenario, to address the challenges of scarce labeled data in supervised learning and the accuracy issues in unsupervised methods, we propose an OpenFE-VIME semi-supervised model. This model synergizes the robustness of supervised approaches with the flexibility of unsupervised approaches. It not only leverages the abundant reservoir of unlabeled data but also addresses the challenges posed by the limited availability of labeled data, enabling reliable and efficient failure detection. Upon evaluation using performance data from OTN node devices in the operator’s optical backbone network, the OpenFE-VIME model demonstrates remarkable performance, achieving an F1-score of 0.947 and accuracy of 0.946, while significantly reducing false negative and false positive rates to 0.073 and 0.035, respectively. Moreover, our research explores the model’s capabilities in utilizing both labeled and unlabeled data and investigates the threshold for training convergence across various data ratios. Additionally, the model’s internal mechanisms and decision-making processes are interpreted using t-SNE visualization, offering enhanced insights into its operational efficacy.

© 2024 Optica Publishing Group

Model and data-centric machine learning algorithms to address data scarcity for failure identification

Lareb Zar Khan, João Pedro, Nelson Costa, Andrea Sgambelluri, Antonio Napoli, and Nicola Sambo
J. Opt. Commun. Netw. 16(3) 369-381 (2024)

Digital-twin-assisted meta learning for soft-failure localization in ROADM-based optical networks

Ruikun Wang, Jiawei Zhang, Zhiqun Gu, Memedhe Ibrahimi, Bojun Zhang, Francesco Musumeci, Massimo Tornatore, and Yuefeng Ji
J. Opt. Commun. Netw. 16(7) C11-C19 (2024)

Experimental investigation of machine-learning-based soft-failure management using the optical spectrum

Lars E. Kruse, Sebastian Kühl, Annika Dochhan, and Stephan Pachnicke
J. Opt. Commun. Netw. 16(2) 94-103 (2024)

Confidentiality-preserving machine learning algorithms for soft-failure detection in optical communication networks

Moises Felipe Silva, Andrea Sgambelluri, Alessandro Pacini, Francesco Paolucci, Andre Green, David Mascarenas, and Luca Valcarenghi
J. Opt. Commun. Netw. 15(8) C212-C222 (2023)

Machine learning models for alarm classification and failure localization in optical transport networks

Jatin Babbar, Ahmed Triki, Reda Ayassi, and Maxime Laye
J. Opt. Commun. Netw. 14(8) 621-628 (2022)