Stochastic Optimization of Economic Dispatch for Microgrid Based on Approximate Dynamic Programming

This paper proposes an approximate dynamic programming (ADP)-based approach for the economic dispatch (ED) of microgrid with distributed generations. The time-variant renewable generation, electricity price, and the power demand are considered as stochastic variables in this paper. An ADP-based ED (ADPED) algorithm is proposed to optimally operate the microgrid under these uncertainties. To deal with the uncertainties, Monte Carlo method is adopted to sample the training scenarios to give empirical knowledge to ADPED. The piecewise linear function (PLF) approximation with improved slope updating strategy is employed for the proposed method. With sufficient information extracted from these scenarios and embedded in the PLF function, the proposed ADPED algorithm can not only be used in day-ahead scheduling but also the intra-day optimization process. The algorithm can make full use of historical prediction error distribution to reduce the influence of inaccurate forecast on the system operation. Numerical simulations demonstrate the effectiveness of the proposed approach. The near-optimal decision obtained by ADPED is very close to the global optimality. And it can be adaptive to both day-ahead and intra-day operation under uncertainty.

[1]  Archie C. Chapman,et al.  A Fast Technique for Smart Home Management: ADP With Temporal Difference Learning , 2018, IEEE Transactions on Smart Grid.

[2]  Bruno Francois,et al.  Emission Reduction and Economical Optimization of an Urban Microgrid Operation Including Dispatched PV-Based Active Generators , 2014, IEEE Transactions on Sustainable Energy.

[3]  Hamidreza Zareipour,et al.  Electricity Price and Demand Forecasting in Smart Grids , 2012, IEEE Transactions on Smart Grid.

[4]  Mohammad Shahidehpour,et al.  Effective Load Carrying Capability Evaluation of Renewable Energy via Stochastic Long-Term Hourly Based SCUC , 2015, IEEE Transactions on Sustainable Energy.

[5]  Ju Liu,et al.  Solution to short-term frequency response of wind farms by using energy storage systems , 2016 .

[6]  Martin Strelec,et al.  Microgrid energy management based on approximate dynamic programming , 2013, IEEE PES ISGT Europe 2013.

[7]  M. L. Crow,et al.  Optimization in energy and power management for renewable-diesel microgrids using Dynamic Programming algorithm , 2012, 2012 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[8]  Warren B. Powell,et al.  An Optimal Approximate Dynamic Programming Algorithm for Concave, Scalar Storage Problems With Vector-Valued Controls , 2013, IEEE Transactions on Automatic Control.

[9]  Jhi-Young Joo,et al.  Economic Dispatch for an Agent-Based Community Microgrid , 2016, IEEE Transactions on Smart Grid.

[10]  Kevin Tomsovic,et al.  Bidding Strategy for Microgrid in Day-Ahead Market Based on Hybrid Stochastic/Robust Optimization , 2016, IEEE Transactions on Smart Grid.

[11]  Mohammad Shahidehpour,et al.  Microgrids for Enhancing the Power Grid Resilience in Extreme Conditions , 2017, IEEE Transactions on Smart Grid.

[12]  Mario Vasak,et al.  Stochastic model predictive control for optimal economic operation of a residential DC microgrid , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[13]  Derong Liu,et al.  Adaptive Dynamic Programming Algorithm for Renewable Energy Scheduling and Battery Management , 2012, Cognitive Computation.

[14]  Jianhui Wang,et al.  Self-Healing Resilient Distribution Systems Based on Sectionalization Into Microgrids , 2015, IEEE Transactions on Power Systems.

[15]  Xiaofeng Meng,et al.  Wind Power Forecasts Using Gaussian Processes and Numerical Weather Prediction , 2014, IEEE Transactions on Power Systems.

[16]  Norberto Fueyo,et al.  The use of cost-generation curves for the analysis of wind electricity costs in Spain , 2011 .

[17]  Seddik Bacha,et al.  Co-Optimization of Storage System Sizing and Control Strategy for Intelligent Photovoltaic Power Plants Market Integration , 2016, IEEE Transactions on Sustainable Energy.

[18]  Haibo He,et al.  Adaptive wide-area power oscillation damper design for photovoltaic plant considering delay compensation , 2017, Monitoring and Control using Synchrophasors in Power Systems with Renewables.

[19]  Jingjie Xiao,et al.  Grid integration and smart grid implementation of emerging technologies in electric power systems through approximate dynamic programming , 2013 .

[20]  Chongqing Kang,et al.  A State-Independent Linear Power Flow Model with Accurate Estimation of Voltage Magnitude , 2018, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[21]  Warren B. Powell,et al.  Optimal Hour-Ahead Bidding in the Real-Time Electricity Market with Battery Storage Using Approximate Dynamic Programming , 2014, INFORMS J. Comput..

[22]  Haibo He,et al.  Goal Representation Heuristic Dynamic Programming on Maze Navigation , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Barack Obama,et al.  The irreversible momentum of clean energy , 2017, Science.

[24]  Bo Zhao,et al.  Stochastic Optimal Operation of Microgrid Based on Chaotic Binary Particle Swarm Optimization , 2016, IEEE Transactions on Smart Grid.

[25]  Derong Liu,et al.  A self-learning scheme for residential energy system control and management , 2013, Neural Computing and Applications.

[26]  Warren B. Powell,et al.  Tutorial on Stochastic Optimization in Energy—Part II: An Energy Storage Illustration , 2016, IEEE Transactions on Power Systems.

[27]  Derong Liu,et al.  A Novel Dual Iterative $Q$-Learning Method for Optimal Battery Management in Smart Residential Environments , 2015, IEEE Transactions on Industrial Electronics.

[28]  Ding Ming,et al.  Dynamic economic dispatch for microgrids including battery energy storage , 2010, The 2nd International Symposium on Power Electronics for Distributed Generation Systems.

[29]  Jiakun Fang Dynamic Optimal Energy Flow in the Integrated Natural Gas and Electrical Power Systems , 2018, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[30]  Qinghua Wu,et al.  Nonlinear maximum power point tracking control and modal analysis of DFIG based wind turbine , 2016 .

[31]  Zechun Hu,et al.  Photovoltaic and solar power forecasting for smart grid energy management , 2015 .

[32]  M. Giesselmann,et al.  Economic dispatch optimization of microgrid in islanded mode , 2014, International Energy and Sustainability Conference 2014.

[33]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[34]  Farshid Keynia,et al.  Day-ahead electricity price forecasting by modified relief algorithm and hybrid neural network , 2010 .

[35]  Warren B. Powell,et al.  A comparison of approximate dynamic programming techniques on benchmark energy storage problems: Does anything work? , 2014, 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[36]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[37]  Seddik Bacha,et al.  Management Strategy for Market Participation of Photovoltaic Power Plants Including Storage Systems , 2016, IEEE Transactions on Industry Applications.

[38]  Derong Liu,et al.  Multibattery Optimal Coordination Control for Home Energy Management Systems via Distributed Iterative Adaptive Dynamic Programming , 2015, IEEE Transactions on Industrial Electronics.

[39]  Jinyu Wen,et al.  Optimal operation for energy storage with wind power generation using adaptive dynamic programming , 2015, 2015 IEEE Power & Energy Society General Meeting.

[40]  Warren B. Powell,et al.  SMART: A Stochastic Multiscale Model for the Analysis of Energy Resources, Technology, and Policy , 2012, INFORMS J. Comput..

[41]  Warren B. Powell,et al.  Approximate Dynamic Programming I: Modeling , 2011 .