Abstract

Deep reinforcement learning (DRL) has been introduced to the routing and spectrum assignment (RSA) of elastic optical networks (EONs) where the RSA policies are learnt during the interaction of a DRL agent with the EON environment. Upon each new traffic arrival, the DRL agent senses the EON state, and makes the RSA decision accordingly. Therefore, the EON state feature extraction is essential for the performance. However, current approaches, mainly based on fully connected neural networks or convolutional neural networks, are unsatisfactory in EON state feature extraction due to the following two reasons. (1) The optical network topology information is not well considered. (2) The path-level features are highly related to the RSA decision, due to the spectrum continuity constraint, while path-level feature extraction has not been well exploited. To overcome the above shortcomings, in this paper, we propose to utilize the Graph Convolutional Neural Network (GCN) and the Recurrent Neural Network (RNN) for the feature extraction of the network topology, and the aggregation of link-level features to path-level features. By doing this, critical RSA-related information can be sensed by the DRL agent to make better actions. Simulation results demonstrate that our proposed method outperforms previous approaches.

Experimental evaluation of a latency-aware routing and spectrum assignment mechanism based on deep reinforcement learning

C. Hernández-Chulde, R. Casellas, R. Martínez, R. Vilalta, and R. Muñoz
J. Opt. Commun. Netw. 15(11) 925-937 (2023)

Pre- and post-processing techniques for reinforcement-learning-based routing and spectrum assignment in elastic optical networks

Takafumi Tanaka and Masayuki Shimoda
J. Opt. Commun. Netw. 15(12) 1019-1029 (2023)

Routing in optical transport networks with deep reinforcement learning

José Suárez-Varela, Albert Mestres, Junlin Yu, Li Kuang, Haoyu Feng, Albert Cabellos-Aparicio, and Pere Barlet-Ros
J. Opt. Commun. Netw. 11(11) 547-558 (2019)

Deep-NFVOrch: leveraging deep reinforcement learning to achieve adaptive vNF service chaining in DCI-EONs

Baojia Li, Wei Lu, and Zuqing Zhu
J. Opt. Commun. Netw. 12(1) A18-A27 (2020)

Leveraging double-agent-based deep reinforcement learning to global optimization of elastic optical networks with enhanced survivability

Xiao Luo, Chen Shi, Liqian Wang, Xue Chen, Yang Li, and Tao Yang
Opt. Express 27(6) 7896-7911 (2019)