Abstract

The introduction of futuristic and challenging use cases of 5G and 6G communications will demand strict requirements in terms of high bandwidth and low latency. Optical backbone networks need to tackle these new network scenarios by offering highly efficient, flexible, and scalable technologies and solutions. In this context, elastic optical networks (EONs) have been recognized as a promising technological transport infrastructure for the future Internet since they can manage the optical spectrum with enhanced flexibility and efficiency. The service provisioning in EONs is a challenging issue to tackle since the routing and spectrum assignment (RSA) is characterized by a high degree of complexity. This work presents an approach for RSA in EONs leveraging the advantages of deep reinforcement learning (DRL) solutions. The devised approach jointly considers the constraints imposed by the optical technologies and the demanded connectivity service requirements (i.e., guaranteed bandwidth and maximum end-to-end latency) when computing and selecting the optical path and spectral resources. We first evaluate our approach through simulation experiments considering two reference network topologies, demonstrating its effectiveness in reducing the bandwidth blocking ratio, the path computation time, and the number of rejected connectivity services requiring lower latencies when compared to a baseline $\rm k$-shortest path routing and first-fit spectrum allocation algorithm. Then, the trained DRL agent is integrated within a real proof of concept to attain an ML-assisted SDN control plane in the CTTC ADRENALINE testbed. The attained performance improvements highlight the potential benefits brought by using DRL mechanisms and its feasible integration within production EON transport infrastructures.

© 2023 Optica Publishing Group

Pre- and post-processing techniques for reinforcement-learning-based routing and spectrum assignment in elastic optical networks

Takafumi Tanaka and Masayuki Shimoda
J. Opt. Commun. Netw. 15(12) 1019-1029 (2023)

Security-aware 5G RAN slice mapping with tiered isolation in physical-layer secured metro-aggregation elastic optical networks using heuristic-assisted DRL

Yunwu Wang, Min Zhu, Jiahua Gu, Xiang Liu, Weidong Tong, Bingchang Hua, Mingzheng Lei, Yuancheng Cai, and Jiao Zhang
J. Opt. Commun. Netw. 15(12) 969-984 (2023)

Deep reinforcement learning for proactive spectrum defragmentation in elastic optical networks

Ehsan Etezadi, Carlos Natalino, Renzo Diaz, Anders Lindgren, Stefan Melin, Lena Wosinska, Paolo Monti, and Marija Furdek
J. Opt. Commun. Netw. 15(10) E86-E96 (2023)

Dynamic slicing of multidimensional resources in DCI-EON with penalty-aware deep reinforcement learning

Meng Lian, Yongli Zhao, Yajie Li, Avishek Nag, and Jie Zhang
J. Opt. Commun. Netw. 16(2) 112-126 (2024)

Network-aware compute and memory allocation in optically composable data centers with deep reinforcement learning and graph neural networks

Zacharaya Shabka and Georgios Zervas
J. Opt. Commun. Netw. 15(2) 133-143 (2023)