Adaptive Critic Design-Based Dynamic Stochastic Optimal Control Design for a Microgrid With Multiple Renewable Resources

This paper proposes a three-layer optimization and an intelligent control algorithm for a microgrid with multiple renewable resources. A dual heuristic dynamic programming-based system control layer is used to ensure the dynamic performance and voltage dynamics of the microgrid as the system operation conditions change. A local layer maximizes the capability of the photovoltaic (PV) wind power generators and battery systems, and a model predictive control-based device layer increases the tracking accuracy of the converter control. The proposed control scheme, system wide adaptive predictive supervisory control (SWAPSC) smooths the output of PV and wind generators under intermittencies, maintains bus voltage by providing dynamic reactive power support to the grid, and reduces the total system losses while minimizing degradation of battery life span. Performance comparisons are made with and without SWAPSC for an IEEE 13 node test system with a PV farm, a wind farm, and two battery-based energy storage systems.

[1]  Shuhui Li,et al.  Using neural networks to estimate wind turbine power generation , 2001 .

[2]  R. Marler,et al.  The weighted sum method for multi-objective optimization: new insights , 2010 .

[3]  Ganesh K. Venayagamoorthy,et al.  Wide-Area Signal-Based OptimalNeurocontroller for a UPFC , 2008 .

[4]  Wei Qiao,et al.  Indirect Adaptive External Neuro-Control for a Series Capacitive Reactance Compensator Based on a Voltage Source PWM Converter in Damping Power Oscillations , 2007, IEEE Transactions on Industrial Electronics.

[5]  Hui Li,et al.  A Stochastic Digital Implementation of a Neural Network Controller for Small Wind Turbine Systems , 2006, IEEE Transactions on Power Electronics.

[6]  Ali Davoudi,et al.  Hierarchical Structure of Microgrids Control System , 2012, IEEE Transactions on Smart Grid.

[7]  M. Abedi,et al.  Decentralized Cooperative Control Strategy of Microsources for Stabilizing Autonomous VSC-Based Microgrids , 2012, IEEE Transactions on Power Systems.

[8]  Jiaqi Liang,et al.  Wide-Area Measurement Based Dynamic Stochastic Optimal Power Flow Control for Smart Grids With High Variability and Uncertainty , 2012, IEEE Transactions on Smart Grid.

[9]  Warren B. Powell,et al.  Handbook of Learning and Approximate Dynamic Programming , 2006, IEEE Transactions on Automatic Control.

[10]  Susan A. Murphy,et al.  Efficient Reinforcement Learning with Multiple Reward Functions for Randomized Controlled Trial Analysis , 2010, ICML.

[11]  Simon De Rijcke,et al.  Grid impact of voltage control and reactive power support by wind turbines equipped with direct-drive synchronous machines , 2013, 2013 IEEE Power & Energy Society General Meeting.

[12]  George Stavrakakis,et al.  Wind power forecasting using advanced neural networks models , 1996 .

[13]  J. Deuse,et al.  Fuzzy Logic Supervisor-Based Primary Frequency Control Experiments of a Variable-Speed Wind Generator , 2009, IEEE Transactions on Power Systems.

[14]  Jin-Hong Jeon,et al.  Dynamic Modeling and Control of a Grid-Connected Hybrid Generation System With Versatile Power Transfer , 2008, IEEE Transactions on Industrial Electronics.

[15]  Salman Mohagheghi,et al.  Optimal wide area controller and state predictor for a power system , 2008, PES 2008.

[16]  Paul J. Werbos,et al.  Approximate dynamic programming for real-time control and neural modeling , 1992 .

[17]  Jiaqi Liang,et al.  Intelligent Local Area Signals Based Damping of Power System Oscillations Using Virtual Generators and Approximate Dynamic Programming , 2013, IEEE Transactions on Smart Grid.

[18]  Adel M. Sharaf,et al.  A rule-based fuzzy logic controller for a PWM inverter in a stand alone wind energy conversion scheme , 1993 .

[19]  Yasser Abdel-Rady I. Mohamed,et al.  Modeling, Analysis, and Stabilization of Converter-Fed AC Microgrids With High Penetration of Converter-Interfaced Loads , 2012, IEEE Transactions on Smart Grid.

[20]  Xi Chen,et al.  Adaptive Critic Design for Energy Minimization of Portable Video Communication Devices , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Minwon Park,et al.  Improvement of Wind-Generator Stability by Fuzzy-Logic-Controlled SMES , 2009, IEEE Transactions on Industry Applications.

[22]  B. G. Fernandes,et al.  Distributed Control to Ensure Proportional Load Sharing and Improve Voltage Regulation in Low-Voltage DC Microgrids , 2013, IEEE Transactions on Power Electronics.

[23]  Wei Qiao.  Integrated control of wind farms, facts devices and the power network using neural networks and adaptive critic designs , 2008 .

[24]  M. A. Abido,et al.  Optimal Design of Microgrids in Autonomous and Grid-Connected Modes Using Particle Swarm Optimization , 2011, IEEE Transactions on Power Electronics.

[25]  S. Bhattacharya,et al.  Control Strategies for Battery Energy Storage for Wind Farm Dispatching , 2009, IEEE Transactions on Energy Conversion.

[26]  Jignesh Solanki,et al.  Coordinated Predictive Control of a Wind/Battery Microgrid System , 2013, IEEE Journal of Emerging and Selected Topics in Power Electronics.

[27]  Srini Narayanan,et al.  Learning all optimal policies with multiple criteria , 2008, ICML '08.