Abstract

The uneven occurrence of certain types of failures in optical networks results in a scarcity of data for less frequent failures, leading to imbalanced datasets for training machine learning (ML) models. This poses a significant bottleneck in terms of reliability and practical implementation of ML for failure management. Existing research works often overlook this aspect while demonstrating high accuracies by utilizing sufficiently balanced training datasets collected in controlled laboratory setups and simulations. However, this approach does not reflect a realistic network scenario. To address this issue, different model-centric and data-centric approaches have been investigated in this work to determine their potential for improving the learning of ML models, specifically neural networks (NNs), on less frequent failures with such imbalanced training datasets. For failure identification, the obtained results suggest that data-centric approaches tend to perform better in terms of classification accuracy, with an improvement of up to 5.5% in F1-score observed on less frequent failures compared to a baseline NN (i.e., without any model-centric or data-centric treatment). However, some data-centric approaches may also have significant additional computational complexity associated with them, and, therefore, a suitable approach should be chosen based on the desired classification performance and available computational resources.

© 2024 Optica Publishing Group

Data augmentation to improve performance of neural networks for failure management in optical networks

Lareb Zar Khan, João Pedro, Nelson Costa, Lorenzo De Marinis, Antonio Napoli, and Nicola Sambo
J. Opt. Commun. Netw. 15(1) 57-67 (2023)

Machine learning models for alarm classification and failure localization in optical transport networks

Jatin Babbar, Ahmed Triki, Reda Ayassi, and Maxime Laye
J. Opt. Commun. Netw. 14(8) 621-628 (2022)

Experimental investigation of machine-learning-based soft-failure management using the optical spectrum

Lars E. Kruse, Sebastian Kühl, Annika Dochhan, and Stephan Pachnicke
J. Opt. Commun. Netw. 16(2) 94-103 (2024)

Digital-twin-assisted meta learning for soft-failure localization in ROADM-based optical networks

Ruikun Wang, Jiawei Zhang, Zhiqun Gu, Memedhe Ibrahimi, Bojun Zhang, Francesco Musumeci, Massimo Tornatore, and Yuefeng Ji
J. Opt. Commun. Netw. 16(7) C11-C19 (2024)

Domain adaptation and transfer learning for failure detection and failure-cause identification in optical networks across different lightpaths [Invited]

Francesco Musumeci, Virajit Garbhapu Venkata, Yusuke Hirota, Yoshinari Awaji, Sugang Xu, Masaki Shiraiwa, Biswanath Mukherjee, and Massimo Tornatore
J. Opt. Commun. Netw. 14(2) A91-A100 (2022)