A Reinforcement Learning Approach to Solve Service Restoration and Load Management Simultaneously for Distribution Networks

Energy and economy are increasing the relationship over the years, where the energy becomes a significant resource to keep a country developing, and it supports its economy. Then, more reliable the energy should become, especially the distribution network, to keep the entire process running. In this level of energy distribution, where residential consumers and medium and small industries are supplied, the number of interconnections of the network is enormous. However, for economic and environmental aspects, these complex systems, which are operating close to their capacity, needs to increase the automation, appearing the concept of smart grids and the Advanced Distribution Management System (ADMS) and its methods to control. Inside of the ADMS, there are a lot of essential techniques. Among them, there are two techniques which are the most relevant for this paper: the self-healing and load management. In an ADMS system, these two techniques are treated separately, but the best solution occurs when they are computed together. In this paper, it is proposed an approach that can address both problems at the same time or individually, i.e., in place to have a sequential method to solve step-by-step the issues in the networks. The proposed algorithm, through reinforcement learning technique, can handle both problems together. The proposed approach is tested in a real urban distribution network with some created scenarios to compare the results with outages and overloads. Some comparisons with other methods are carried out.

[1]  Juan Li,et al.  Analysis, control, and economic impact assessment of major blackout events , 2008 .

[2]  Khizir Mahmud,et al.  Peak-Load Reduction by Coordinated Response of Photovoltaics, Battery Storage, and Electric Vehicles , 2018, IEEE Access.

[3]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[4]  A. R. Aoki,et al.  Distributed Intelligent System for Self-Healing in Smart Grids , 2018, IEEE Transactions on Power Delivery.

[5]  Walmir Freitas,et al.  Integrated volt/Var control in modern distribution power systems based on support vector machines , 2016 .

[6]  Mark Johnson,et al.  Power interruption costs to industrial and commercial consumers of electricity , 1996 .

[7]  Tao Yu,et al.  A new generation of AI: A review and perspective on machine learning technologies applied to smart energy and electric power systems , 2019, International Journal of Energy Research.

[8]  James A. Momoh,et al.  Smart Grid: Fundamentals of Design and Analysis , 2012 .

[9]  K. N. Srinivas,et al.  Restoration of power network – a bibliographic survey , 2011 .

[10]  MengChu Zhou,et al.  A Distributed Dynamic Programming-Based Solution for Load Management in Smart Grids , 2017, IEEE Systems Journal.

[11]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[12]  Mahmoud Moghavvemi,et al.  Load Shedding and Smart-Direct Load Control Using Internet of Things in Smart Grid Demand Response Management , 2017, IEEE Transactions on Industry Applications.

[13]  Caterina Scoglio,et al.  Shipboard power system reconfiguration using reinforcement learning , 2010, North American Power Symposium 2010.

[14]  Shengwei Mei,et al.  Mitigating the Risk of Cascading Blackouts: A Data Inference Based Maintenance Method , 2018, IEEE Access.

[15]  Chia-Hung Lin,et al.  A multiagent‐based distribution automation system for service restoration of fault contingencies , 2011 .

[16]  Thelma S. P. Fernandes,et al.  Load shedding through optimal power flow to support self-healing actions in distribution feeders , 2014, 2014 IEEE PES Transmission & Distribution Conference and Exposition - Latin America (PES T&D-LA).

[17]  Cansin Yaman Evrenosoglu,et al.  A Fault Classification and Localization Method for Three-Terminal Circuits Using Machine Learning , 2013, IEEE Transactions on Power Delivery.

[18]  Le Xie,et al.  Impact of Data Quality in Home Energy Management System on Distribution System State Estimation , 2018, IEEE Access.

[19]  Shengwei Mei,et al.  Fast Searching Strategy for Critical Cascading Paths Toward Blackouts , 2018, IEEE Access.

[20]  Pengwei Du,et al.  Day-Ahead Load Peak Shedding/Shifting Scheme Based on Potential Load Values Utilization: Theory and Practice of Policy-Driven Demand Response in China , 2017, IEEE Access.

[21]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[22]  J. A. Pecas Lopes,et al.  Service restoration on distribution systems using Multi‐MicroGrids , 2011 .

[23]  Sanjoy Das,et al.  Dynamic reconfiguration of shipboard power systems using reinforcement learning , 2013, IEEE Transactions on Power Systems.

[24]  Roy Billinton,et al.  Customer cost of electric service interruptions , 1989, Proc. IEEE.

[25]  T.S.P. Fernandes,et al.  Load Shedding Strategies Using Optimal Load Flow With Relaxation of Restrictions , 2008, IEEE Transactions on Power Systems.