Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Machine Learning for Network Automation: Overview, Architecture, and Applications [Invited Tutorial]

Open Access Open Access

Abstract

Networks are complex interacting systems involving cloud operations, core and metro transport, and mobile connectivity all the way to video streaming and similar user applications. With localized and highly engineered operational tools, it is typical of these networks to take days to weeks for any changes, upgrades, or service deployments to take effect. Machine learning, a sub-domain of artificial intelligence, is highly suitable for complex system representation. In this tutorial paper, we review several machine learning concepts tailored to the optical networking industry and discuss algorithm choices, data and model management strategies, and integration into existing network control and management tools. We then describe four networking case studies in detail, covering predictive maintenance, virtual network topology management, capacity optimization, and optical spectral analysis.

© 2018 Optical Society of America

Full Article  |  PDF Article
More Like This
Intent-based networking and its application to optical networks [Invited Tutorial]

L. Velasco, S. Barzegar, F. Tabatabaeimehr, and M. Ruiz
J. Opt. Commun. Netw. 14(1) A11-A22 (2022)

Using Machine Learning in Communication Networks [Invited]

David Côté
J. Opt. Commun. Netw. 10(10) D100-D109 (2018)

Two Use Cases of Machine Learning for SDN-Enabled IP/Optical Networks: Traffic Matrix Prediction and Optical Path Performance Prediction [Invited]

Gagan Choudhury, David Lynch, Gaurav Thakur, and Simon Tse
J. Opt. Commun. Netw. 10(10) D52-D62 (2018)

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (23)

Fig. 1.
Fig. 1. Heterogeneous optical network architecture.
Fig. 2.
Fig. 2. Machine learning model construction and test workflow.
Fig. 3.
Fig. 3. ML families. The first box in each column identifies the main characterization of the ML approach; the second box identifies examples of algorithms used in the approach; and the third box indicates examples of applications that can take advantage of the approach.
Fig. 4.
Fig. 4. Illustrative example of a dual-layer ANN architecture.
Fig. 5.
Fig. 5. Underfitting versus overfitting.
Fig. 6.
Fig. 6. k -fold cross-validation.
Fig. 7.
Fig. 7. ROC- and AUC-based classifier evaluation. The dotted and dashed lines are examples of typical ROC curves; the classifier corresponding to the dashed line provides better performance.
Fig. 8.
Fig. 8. Model-driven telemetry stack. REST, representational state transfer; RHU, remote hub unit; VNF, virtual network function.
Fig. 9.
Fig. 9. Data storage and representation workflow and technologies.
Fig. 10.
Fig. 10. Self-driven networking architecture.
Fig. 11.
Fig. 11. Adaptive model update based on changing data profile, as opposed to fixed duration periodic updates. (a) Normal distribution of optical power levels. (b) Abnormal distribution of optical power levels.
Fig. 12.
Fig. 12. Fault management functional hierarchy.
Fig. 13.
Fig. 13. SDN-integrated fault discovery (detection) and diagnosis. (a) System-level FDD. (b) Node-level FDD.
Fig. 14.
Fig. 14. (a) Localized fault discovery at the node. (b) Local feature similarity analysis for root cause analysis.
Fig. 15.
Fig. 15. (a)–(c) Reactive and proactive adaptation. Numbers in the inset represent link capacity in gigabits per second (Gb/s). (d) Maximum prediction error versus days of monitoring.
Fig. 16.
Fig. 16. (a) and (b) Prediction of min/max/avg for two different traffic profiles, and (c) ANN adaptation to smooth evolutionary bit rate.
Fig. 17.
Fig. 17. Maximum used transponders versus load.
Fig. 18.
Fig. 18. Network setup and ML input and output parameters.
Fig. 19.
Fig. 19. (a) Classifiers’ performance. (b) Training time.
Fig. 20.
Fig. 20. Example of optical spectrum and signal features.
Fig. 21.
Fig. 21. Example of filter failures considered in this paper: (a) FS and (b) FT.
Fig. 22.
Fig. 22. Workflow for filter failure detection and identification.
Fig. 23.
Fig. 23. Accuracy of the proposed method for (a) FS and (b) FT identification.

Tables (5)

Tables Icon

Algorithm 2 Q-Learning

Tables Icon

TABLE I Confusion Matrix for a Binary Classifier

Tables Icon

TABLE II Examples of Optical Network Data Sources

Tables Icon

TABLE III Legacy Versus Model-Driven Network Telemetry

Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.