Approximate dynamic programming based supplementary reactive power control for DFIG wind farm to enhance power system stability

Reactive power control of doubly fed induction generators (DFIGs) has been a heated topic in transient stability control of power systems in recent years. By using a new online supplementary learning control (OSLC) approach based on the theory of approximate dynamic programming (ADP), this paper develops an optimal and adaptive design method for the supplementary reactive power control of DFIGs to improve transient stability of power systems. To augment the reactive power command of the rotor-side converter (RSC), a supplementary controller is designed to reduce voltage sag at the common coupling point during a fault, and to mitigate active power oscillation of the wind farm after a fault. As a result, the transient stability of both DFIGs and the power system is enhanced. For the supplementary controller design, an action dependent cost function is introduced to make the OSLC model-free and completely data-driven. Furthermore, a least-squares based policy iteration algorithm is employed to train the supplementary controller with convergence and stability guarantee. By using such techniques, the supplementary reactive power controller can be trained directly from data measurements, and therefore, can adapt to system or external changes without an explicit offline system identification process. Simulations carried out in Power System Computer Aided Design/ Electro Magnetic Transient in DC System (PSCAD/EMTDC) show that the OSLC based supplementary reactive power controller can significantly improve the transient performance of the wind farm and enhance the transient stability of the power system after sever faults.

[1]  Haibo He,et al.  Reactive power control of grid-connected wind farm based on adaptive dynamic programming , 2014, Neurocomputing.

[2]  Wei Qiao,et al.  Feed-Forward Transient Current Control for Low-Voltage Ride-Through Enhancement of DFIG Wind Turbines , 2010, IEEE Transactions on Energy Conversion.

[3]  Jinyu Wen,et al.  Energy-Storage-Based Low-Frequency Oscillation Damping Control Using Particle Swarm Optimization and Heuristic Dynamic Programming , 2014, IEEE Transactions on Power Systems.

[4]  U.D. Annakkage,et al.  A platform for validation of FACTS models , 2006, IEEE Transactions on Power Delivery.

[5]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[6]  Jianliang Wang,et al.  Quantized $H_{\infty}$ Consensus of Multiagent Systems With Quantization Mismatch Under Switching Weighted Topologies , 2017, IEEE Transactions on Control of Network Systems.

[7]  S. O. Faried,et al.  Utilizing DFIG-Based Wind Farms for Damping Subsynchronous Resonance in Nearby Turbine-Generators , 2013, IEEE Transactions on Power Systems.

[8]  R. Bellman,et al.  Dynamic Programming and Markov Processes , 1960 .

[9]  Haibo He,et al.  Multi-machine power system control based on dual heuristic dynamic programming , 2014, 2014 IEEE Symposium on Computational Intelligence Applications in Smart Grid (CIASG).

[10]  Huaguang Zhang,et al.  Adaptive Dynamic Programming: An Introduction , 2009, IEEE Computational Intelligence Magazine.

[11]  Michail G. Lagoudakis,et al.  Least-Squares Policy Iteration , 2003, J. Mach. Learn. Res..

[12]  Haibo He,et al.  A three-network architecture for on-line learning and optimization based on adaptive dynamic programming , 2012, Neurocomputing.

[13]  P. K. Sen,et al.  A comparative study of the implementation of STATCOM and SVC on DFIG-based wind farm connected to a power system , 2012, 2012 IEEE Power and Energy Society General Meeting.

[14]  Warren B. Powell,et al.  Handbook of Learning and Approximate Dynamic Programming , 2006, IEEE Transactions on Automatic Control.

[15]  Haibo He,et al.  Power System Stability Control for a Wind Farm Based on Adaptive Dynamic Programming , 2015, IEEE Transactions on Smart Grid.

[16]  Tarek Medalel Masaud,et al.  Study of the implementation of STATCOM on DFIG-based wind farm connected to a power system , 2012, 2012 IEEE PES Innovative Smart Grid Technologies (ISGT).

[17]  Zwe-Lee Gaing A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004, IEEE Transactions on Energy Conversion.

[18]  Lie Xu,et al.  Coordinated reactive power control for facilitating fault ride through of doubly fed induction generator- and fixed speed induction generator-based wind farms , 2010 .

[19]  Chao Lu,et al.  Direct Heuristic Dynamic Programming for Damping Oscillations in a Large Power System , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Damian Flynn,et al.  Decoupled-DFIG Fault Ride-Through Strategy for Enhanced Stability Performance During Grid Faults , 2010, IEEE Transactions on Sustainable Energy.

[21]  Haibo He,et al.  Adaptive control for an HVDC transmission link with FACTS and a wind farm , 2013, 2013 IEEE PES Innovative Smart Grid Technologies Conference (ISGT).

[22]  Jennie Si,et al.  Online learning control by association and reinforcement , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[23]  M. Kayikci,et al.  Reactive Power Control Strategies for DFIG-Based Plants , 2007, IEEE Transactions on Energy Conversion.

[24]  Feng Liu,et al.  Online Supplementary ADP Learning Controller Design and Application to Power System Frequency Control With Large-Scale Wind Energy Integration , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[25]  F. Lewis,et al.  Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers , 2012, IEEE Control Systems.

[26]  Jiaqi Liang,et al.  Wide-Area Measurement Based Dynamic Stochastic Optimal Power Flow Control for Smart Grids With High Variability and Uncertainty , 2012, IEEE Transactions on Smart Grid.

[27]  R.G. Harley,et al.  Real-Time Implementation of a STATCOM on a Wind Farm Equipped With Doubly Fed Induction Generators , 2006, IEEE Transactions on Industry Applications.

[28]  Feng Liu,et al.  Reactive power control of DFIG wind farm using online supplementary learning controller based on approximate dynamic programming , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[29]  Ganesh Kumar Venayagamoorthy,et al.  Two-Level Dynamic Stochastic Optimal Power Flow Control for Power Systems With Intermittent Renewable Generation , 2014, IEEE Transactions on Power Systems.

[30]  George G. Lendaris,et al.  Adaptive dynamic programming , 2002, IEEE Trans. Syst. Man Cybern. Part C.