Survivability-aware routing restoration mechanism for smart grid communication network in large-scale failures

Natural disasters such as earthquakes have consecutive impacts on the smart grid because of aftershock activities. To guarantee service requirements and smart grid stable operations, it is a challenge to design a fast and survivable rerouting mechanism. There are few studies that consider concurrent rerouting aiming at multiple services in smart grid communication network, however. Firstly, we formulate the node survivability, link survivability, and path survivability model in terms of the distance from the epicenter to the node and the link of the network. Meanwhile, we introduce the indicator of site difference level which is unique in the smart grid to further restrict the service path. Secondly, to improve the algorithm efficiency and reduce rerouting time, the deep first search algorithm is utilized to obtain the available rerouting set, and then the I-DQN based on the framework of reinforcement learning is proposed to achieve concurrent rerouting for multiple services. The experimental results show that our approach has a better convergence performance and higher survivability as well as the approximate latency in comparison with other approaches.

[1]  Arjan Durresi,et al.  Quality of Service (QoS) in Software Defined Networking (SDN): A survey , 2017, J. Netw. Comput. Appl..

[2]  Jonathan Grudin,et al.  Design and evaluation , 1995 .

[3]  Xiaohong Huang,et al.  Deep Reinforcement Learning for Multimedia Traffic Control in Software Defined Networking , 2018, IEEE Network.

[4]  Ian F. Akyildiz,et al.  QoS-Aware Adaptive Routing in Multi-layer Hierarchical Software Defined Networks: A Reinforcement Learning Approach , 2016, 2016 IEEE International Conference on Services Computing (SCC).

[5]  Alex Graves,et al.  Playing Atari with Deep Reinforcement Learning , 2013, ArXiv.

[6]  Theodore B. Zahariadis,et al.  Smart Grid: a demanding use case for 5G technologies , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[7]  DurresiArjan,et al.  Quality of Service (QoS) in Software Defined Networking (SDN) , 2017 .

[8]  Xiaohong Jiang,et al.  Network survivability against region failure , 2011, 2011 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC).

[9]  Eytan Modiano,et al.  Assessing the Vulnerability of the Fiber Infrastructure to Disasters , 2009, IEEE INFOCOM 2009.

[10]  Haci Ali Mantar,et al.  k -Maximally Disjoint Path Routing Algorithms for SDN , 2015, 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[11]  Deepak Karia,et al.  Network recovery using IP fast rerouting for multi link failures , 2017, 2017 International Conference on Intelligent Computing and Control (I2C2).

[12]  Zhao Wei,et al.  Active Sampling for Deep Q-Learning Based on TD-error Adaptive Correction , 2019 .

[13]  Lei Shi,et al.  A service routing reconstruction approach in cyber-physical power system based on risk balance , 2018, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[14]  G. Sussman Banking on Telecommunications: The World Bank in the Philippines , 1987 .

[15]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[16]  Yasir Saleem,et al.  Clustering and Reinforcement-Learning-Based Routing for Cognitive Radio Networks , 2017, IEEE Wireless Communications.

[17]  Puyuan Zhao,et al.  Comprehensive vulnerability assessment and optimization method for smart grid communication transmission systems , 2017, 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[18]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[19]  D. Schupke,et al.  Diverse routing based on shared risk link groups , 2009, 2009 7th International Workshop on Design of Reliable Communication Networks.

[20]  Xiaojiang Du,et al.  Self-protecting networking using dynamic p-cycle construction within link capacity constraint , 2012, Secur. Commun. Networks.

[21]  Emiliano Sisinni,et al.  Characterization of IP-Based Communication for Smart Grid Using Software-Defined Networking , 2018, IEEE Transactions on Instrumentation and Measurement.

[22]  Abishek Gopalan,et al.  IP Fast Rerouting for Multi-Link Failures , 2016, IEEE/ACM Transactions on Networking.

[23]  Fan Zhang,et al.  A Kind of Joint Routing and Resource Allocation Scheme Based on Prioritized Memories-Deep Q Network for Cognitive Radio Ad Hoc Networks , 2018, Sensors.

[24]  Xiaoning Zhang,et al.  Congestion-aware local reroute for fast failure recovery in software-defined networks , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[25]  Shahram Shah-Heydari,et al.  Enhancing network service survivability in large-scale failure scenarios , 2014, Journal of Communications and Networks.

[26]  Lei Shi,et al.  Risk-Aware Service Routes Planning for System Protection Communication Network in Energy Internet , 2019, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[27]  Wen Wu,et al.  Deep Reinforcement Learning for Router Selection in Network With Heavy Traffic , 2019, IEEE Access.

[28]  Joel J. P. C. Rodrigues,et al.  SDN-Enabled Multi-Attribute-Based Secure Communication for Smart Grid in IIoT Environment , 2018, IEEE Transactions on Industrial Informatics.

[29]  Mingwei Xu,et al.  Fast Rerouting Against Multi-Link Failures Without Topology Constraint , 2018, IEEE/ACM Transactions on Networking.

[30]  Yasir Saleem,et al.  Internet of Things-Aided Smart Grid: Technologies, Architectures, Applications, Prototypes, and Future Research Directions , 2017, IEEE Access.

[31]  Tomislav Dragicevic,et al.  Future effectual role of energy delivery: A comprehensive review of Internet of Things and smart grid , 2018, Renewable and Sustainable Energy Reviews.

[32]  Brendan Jennings,et al.  Software Defined Networks-Based Smart Grid Communication: A Comprehensive Survey , 2018, IEEE Communications Surveys & Tutorials.

[33]  Puyuan Zhao,et al.  Risk analysis and optimization for communication transmission link interruption in Smart Grid cyber-physical system , 2018, Int. J. Distributed Sens. Networks.

[34]  Lei Guo,et al.  A survivability routing mechanism in SDN enabled wireless mesh networks: Design and evaluation , 2016, China Communications.

[35]  Young-Bae Ko,et al.  Trends and Potentials of the Smart Grid Infrastructure: From ICT Sub-System to SDN-Enabled Smart Grid Architecture , 2015 .

[36]  Shahram Shah-Heydari,et al.  Network survivability in large-scale regional failure scenarios , 2009, C3S2E '09.

[37]  Ramjee Prasad,et al.  Security for Smart Grid in 5G and Beyond Networks , 2019, Wirel. Pers. Commun..