Impact of signal transmission delays on power system damping control using heuristic dynamic programming

In this paper, the impact of signal transmission delays on static VAR compensator (SVC) based power system damping control using reinforcement learning is investigated. The SVC is used to damp low-frequency oscillation between interconnected power systems under fault conditions, where measured signals from remote areas are first collected and then transmitted to the controller as the inputs. Inevitable signal transmission delays are introduced into such design that will degrade the dynamic performance of SVC and in the worst case, cause system instability. The adopted reinforcement learning algorithm, called goal representation heuristic dynamic programming (GrHDP), is employed to design the SVC controller. Impact of signal transmission delays on the adopted controller is investigated with fully transient model based time-domain simulation in Matlab/Simulink environment. The simulation results on a four-machine two-area benchmark system with SVC demonstrate the effectiveness of the adopted algorithm on damping control and the impact of signal transmission delays.

[1]  Haibo He,et al.  Reactive power control of grid-connected wind farm based on adaptive dynamic programming , 2014, Neurocomputing.

[2]  Haibo He,et al.  Power System Stability Control for a Wind Farm Based on Adaptive Dynamic Programming , 2015, IEEE Transactions on Smart Grid.

[3]  Haibo He.  Self-Adaptive Systems for Machine Intelligence , 2011 .

[4]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[5]  Wei Qiao,et al.  Optimal wide-area monitoring and nonlinear adaptive coordinating neurocontrol of a power system with wind power integration and multiple FACTS devices , 2008, Neural Networks.

[6]  Haibo He,et al.  A three-network architecture for on-line learning and optimization based on adaptive dynamic programming , 2012, Neurocomputing.

[7]  Jinyu Wen,et al.  Adaptive Learning in Tracking Control Based on the Dual Critic Network Design , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[8]  G.T. Heydt,et al.  Evaluation of time delay effects to wide-area power system stabilizer design , 2004, IEEE Transactions on Power Systems.

[9]  Haibo He,et al.  Adaptive control for an HVDC transmission link with FACTS and a wind farm , 2013, 2013 IEEE PES Innovative Smart Grid Technologies Conference (ISGT).

[10]  Jinyu Wen,et al.  Energy-Storage-Based Low-Frequency Oscillation Damping Control Using Particle Swarm Optimization and Heuristic Dynamic Programming , 2014, IEEE Transactions on Power Systems.

[11]  Q. H. Wu,et al.  Delay-Dependent Stability for Load Frequency Control With Constant and Time-Varying Delays , 2009, IEEE Transactions on Power Systems.

[12]  Chao Lu,et al.  Direct Heuristic Dynamic Programming for Damping Oscillations in a Large Power System , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  P. Kundur,et al.  Power system stability and control , 1994 .

[14]  J. Wen,et al.  Delay-Dependent Stability Analysis of the Power System With a Wide-Area Damping Controller Embedded , 2011, IEEE Transactions on Power Systems.

[15]  J. Wen,et al.  Delay-dependent stability for load frequency control with constant and time-varying delays , 2009, 2009 IEEE Power & Energy Society General Meeting.

[16]  G.T. Heydt,et al.  Latency Viewed as a Stochastic Process and its Impact on Wide Area Power System Control Signals , 2008, IEEE Transactions on Power Systems.

[17]  Balarko Chaudhuri,et al.  Wide-area measurement-based stabilizing control of power system considering signal transmission delay , 2004 .

[18]  Wei Yao,et al.  Wide-Area Damping Controller of FACTS Devices for Inter-Area Oscillations Considering Communication Time Delays , 2014, IEEE Transactions on Power Systems.

[19]  Jun Yan,et al.  Cascading Failure Analysis With DC Power Flow Model and Transient Stability Analysis , 2015, IEEE Transactions on Power Systems.

[20]  R. Stephenson.  A and V , 1962, The British journal of ophthalmology.

[21]  Haibo He,et al.  Frequency control using on-line learning method for island smart grid with EVs and PVs , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[22]  W. Marsden.  I and J , 2012 .

[23]  Haibo He,et al.  GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Haibo He,et al.  Goal Representation Heuristic Dynamic Programming on Maze Navigation , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Jennie Si,et al.  Online learning control by association and reinforcement , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[26]  Haibo He,et al.  Comparative study between HDP and PSS on DFIG damping control , 2013, 2013 IEEE Computational Intelligence Applications in Smart Grid (CIASG).

[27]  Haibo He.  Self-Adaptive Systems for Machine Intelligence: He/Machine Intelligence , 2011 .