Dynamic Energy Management of a Microgrid Using Approximate Dynamic Programming and Deep Recurrent Neural Network Learning

This paper focuses on economical operation of a microgrid (MG) in real-time. A novel dynamic energy management system is developed to incorporate efficient management of energy storage system into MG real-time dispatch while considering power flow constraints and uncertainties in load, renewable generation and real-time electricity price. The developed dynamic energy management mechanism does not require long-term forecast and optimization or distribution knowledge of the uncertainty, but can still optimize the long-term operational costs of MGs. First, the real-time scheduling problem is modeled as a finite-horizon Markov decision process over a day. Then, approximate dynamic programming and deep recurrent neural network learning are employed to derive a near optimal real-time scheduling policy. Last, using real power grid data from California independent system operator, a detailed simulation study is carried out to validate the effectiveness of the proposed method.

[1]  D. Bertsekas Approximate policy iteration: a survey and some new methods , 2011 .

[2]  Magdi S. Mahmoud,et al.  Adaptive intelligent techniques for microgrid control systems: A survey , 2017 .

[3]  Felipe Valencia,et al.  Robust Energy Management System Based on Interval Fuzzy Models , 2016, IEEE Transactions on Control Systems Technology.

[4]  Yu Zhang,et al.  Robust Energy Management for Microgrids With High-Penetration Renewables , 2012, IEEE Transactions on Sustainable Energy.

[5]  Kai Strunz,et al.  A BENCHMARK LOW VOLTAGE MICROGRID NETWORK , 2005 .

[6]  Babak Fahimi,et al.  Economic Dispatch of a Hybrid Microgrid With Distributed Energy Storage , 2015, IEEE Transactions on Smart Grid.

[7]  Jie Xu,et al.  Real-Time Energy Storage Management for Renewable Integration in Microgrid: An Off-Line Optimization Approach , 2015, IEEE Transactions on Smart Grid.

[8]  Evangelos Rikos,et al.  Stochastic model predictive control for economic/environmental operation management of microgrids: An experimental case study , 2016 .

[9]  Warren B. Powell,et al.  A comparison of approximate dynamic programming techniques on benchmark energy storage problems: Does anything work? , 2014, 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL).

[10]  Doina Precup,et al.  A Convergent Form of Approximate Policy Iteration , 2002, NIPS.

[11]  Evangelos Rikos,et al.  A Model Predictive Control Approach to Microgrid Operation Optimization , 2014, IEEE Transactions on Control Systems Technology.

[12]  Mumtaz Karatas,et al.  A robust optimization approach to hybrid microgrid operation using ensemble weather forecasts , 2017 .

[13]  Shahin Sirouspour,et al.  An Optimal Energy Storage Control Strategy for Grid-connected Microgrids , 2014, IEEE Transactions on Smart Grid.

[14]  Jinyu Wen,et al.  Optimal operation for energy storage with wind power generation using adaptive dynamic programming , 2015, 2015 IEEE Power & Energy Society General Meeting.

[15]  Lee A. Feldkamp,et al.  Decoupled extended Kalman filter training of feedforward layered networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[16]  Taher Niknam,et al.  New Stochastic Bi-Objective Optimal Cost and Chance of Operation Management Approach for Smart Microgrid , 2016, IEEE Transactions on Industrial Informatics.

[17]  Wencong Su,et al.  Stochastic Energy Scheduling in Microgrids With Intermittent Renewable Energy Resources , 2014, IEEE Transactions on Smart Grid.

[18]  Stefan Tenbohlen,et al.  Optimization of unit commitment and economic dispatch in microgrids based on genetic algorithm and mixed integer linear programming , 2018 .

[19]  Chen Chen,et al.  Coordinated energy management of networked Microgrids in distribution systems , 2015 .

[20]  Warren B. Powell,et al.  Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley Series in Probability and Statistics) , 2007 .

[21]  Yan Lu,et al.  Toward Optimal Day-Ahead Scheduling and Operation Control of Microgrids Under Uncertainty , 2015, IEEE Transactions on Smart Grid.

[22]  Tao Ding,et al.  A Two-Layer Model for Microgrid Real-Time Dispatch Based on Energy Storage System Charging/Discharging Hidden Costs , 2017, IEEE Transactions on Sustainable Energy.

[23]  Vassilios G. Agelidis,et al.  Model Predictive Control for Distributed Microgrid Battery Energy Storage Systems , 2017, IEEE Transactions on Control Systems Technology.

[24]  R D Zimmerman,et al.  MATPOWER: Steady-State Operations, Planning, and Analysis Tools for Power Systems Research and Education , 2011, IEEE Transactions on Power Systems.

[25]  Warren B. Powell,et al.  Co-Optimizing Battery Storage for the Frequency Regulation and Energy Arbitrage Using Multi-Scale Dynamic Programming , 2018, IEEE Transactions on Smart Grid.

[26]  Warren B. Powell,et al.  Benchmarking a Scalable Approximate Dynamic Programming Algorithm for Stochastic Control of Grid-Level Energy Storage , 2018, INFORMS J. Comput..

[27]  Ken Nagasaka,et al.  Multiobjective Intelligent Energy Management for a Microgrid , 2013, IEEE Transactions on Industrial Electronics.

[28]  Sergios Theodoridis,et al.  Machine Learning: A Bayesian and Optimization Perspective , 2015 .

[29]  Daniele Cocco,et al.  Real-time integration of optimal generation scheduling with MPC for the energy management of a renewable hydrogen-based microgrid , 2016 .

[30]  T. Nguyen,et al.  Stochastic Optimization of Renewable-Based Microgrid Operation Incorporating Battery Operating Cost , 2016, IEEE Transactions on Power Systems.

[31]  Warren B. Powell,et al.  Low-Rank Value Function Approximation for Co-Optimization of Battery Storage , 2018, IEEE Transactions on Smart Grid.

[32]  P. Pinson,et al.  Generation and evaluation of space–time trajectories of photovoltaic power , 2016, 1603.06649.

[33]  Amandeep Kaur,et al.  A review on microgrid central controller , 2016 .

[34]  Zhen Ni,et al.  A Computationally Efficient Optimization Approach for Battery Systems in Islanded Microgrid , 2018, IEEE Transactions on Smart Grid.