Reinforcement learning approach for congestion management and cascading failure prevention with experimental application

Abstract This article proposes a method based on the reinforcement learning (RL) for preventing cascading failure (CF) and blackout in smart grids by acting on the output power of the generators in real-time. The proposed research work utilizes the Q-learning algorithm to train the system for the optimal action selection strategy during the state-action learning process by updating the action values based on the obtained rewards. The trained system then is able to relieve congestion of transmission lines in real-time by adjusting the output power of the generators (actions) to prevent consecutive line outages and blackout after N-1 and N-1-1 contingency conditions. The proposed RL-based control is validated through experimental implementation as well as simulation studies on the IEEE 118-bus test system for different contingency case studies. The results obtained from the experimental and simulation studies show the accuracy and robustness of the proposed approach in preventing cascading failure and blackout.