Microgrid energy management based on approximate dynamic programming

Microgrid energy management stands for challenging optimization problem where continuous (economic dispatch) and discrete optimization (unit commitment) tasks are solved. Often Microgrid optimization leads to complex problem where optimization methods usually meet curse of dimensionality. We adopt approximate dynamic programming (ADP) as the promising optimization technique which can overcome curse of dimensionality. In this paper, energy management system based on ADP is introduced and its behavior is demonstrated on small scale Microgrid which is connected to distribution network and includes wind turbine, chiller plant, thermal storage and cooling load. The paper describes policy search approach to ADP and selected approximation architectures in the context of energy optimization. The ADP results are compared with the results of the solution based on dynamic programming approach.

[1]  Lang Tong,et al.  Modeling and Stochastic Control for Home Energy Management , 2013, IEEE Transactions on Smart Grid.

[2]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[3]  Alex M. Andrew,et al.  ROBOT LEARNING, edited by Jonathan H. Connell and Sridhar Mahadevan, Kluwer, Boston, 1993/1997, xii+240 pp., ISBN 0-7923-9365-1 (Hardback, 218.00 Guilders, $120.00, £89.95). , 1999, Robotica (Cambridge. Print).

[4]  Birgitte Bak-Jensen,et al.  Markov model of wind power time series using Bayesian inference of transition matrix , 2009, 2009 35th Annual Conference of IEEE Industrial Electronics.

[5]  Bart De Schutter,et al.  Reinforcement Learning and Dynamic Programming Using Function Approximators , 2010 .

[6]  Youmin Zhang,et al.  A Fast U-d Factorization-based Learning Algorithm with Applications to Nonlinear System Modeling and Identification , 2022 .

[7]  Ding Ming,et al.  Dynamic economic dispatch for microgrids including battery energy storage , 2010, The 2nd International Symposium on Power Electronics for Distributed Generation Systems.

[8]  Zheng Zhao,et al.  Optimal Energy Management for Microgrids , 2012 .

[9]  Alessandro Abate,et al.  Modeling and simulation of a microgrid as a Stochastic Hybrid System , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[10]  B. J. Newton,et al.  Modeling of Solar Storage Tanks , 1995 .

[11]  S. Chowdhury,et al.  Microgrids and Active Distribution Networks , 2009 .

[12]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[13]  Luigi Glielmo,et al.  Energy efficient microgrid management using Model Predictive Control , 2011, IEEE Conference on Decision and Control and European Control Conference.