Dynamic Control of Transparent Optical Networks with Adaptive State-Value Assessment Enabled by Reinforcement Learning

For efficient and dynamic path operations in transparent optical networks, routing and wavelength assignment (RWA) must be optimized in terms of not only link-resource utilization but also traffic distribution. In this paper, we propose a reinforcement-learning-based RWA algorithm that maximizes the number of paths to be accommodated to a network with pre-training using estimated traffic distributions. Numerical experiments elucidate that the number of paths accommodated increases by up to 9.1%.

[1]  David Eppstein,et al.  Finding the k Shortest Paths , 1999, SIAM J. Comput..

[2]  Yuki Terada,et al.  Residual capacity aware dynamic control of GRE-based routing optical path networks under traffic growth model , 2015, 2015 Optical Fiber Communications Conference and Exhibition (OFC).

[3]  Joao Pedro,et al.  Machine learning models for estimating quality of transmission in DWDM networks , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[4]  Mohit Chamania,et al.  Artificial Intelligence (AI) Methods in Optical Networks: A Comprehensive Survey , 2018, Opt. Switch. Netw..

[5]  Jan Späth,et al.  A Set of Typical Transport Network Scenarios for Network Modelling , 2004 .

[6]  L. Velasco,et al.  CAPEX study for grid dependent multi-layer IP/MPLS-over-EON using relative BV-WSS costs , 2012, OFC/NFOEC.

[7]  David Cote,et al.  Using machine learning in communication networks [Invited] , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[8]  Albert Cabellos-Aparicio,et al.  Routing Based on Deep Reinforcement Learning in Optical Transport Networks , 2019, 2019 Optical Fiber Communications Conference and Exhibition (OFC).

[9]  Yao Li,et al.  Deep-neural-network-based wavelength selection and switching in ROADM systems , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[10]  Roberto Proietti,et al.  Multi-Agent Deep Reinforcement Learning in Cognitive Inter-Domain Networking with Multi-Broker Orchestration , 2019, 2019 Optical Fiber Communications Conference and Exhibition (OFC).

[11]  Admela Jukan,et al.  Machine-learning-based prediction for resource (Re)allocation in optical data center networks , 2018, IEEE/OSA Journal of Optical Communications and Networking.