Supplementary damping controller of grid connected dc micro-grids based on Q-learning

In this paper, a new near optimal supplementary damping controller is proposed for grid connected dc microgrids with small power capacities using the Q-learning algorithm. A novel system discretization approach is presented to formulate the power system stability problem into a Q-learning solvable format. A numerical example is provided for illustration of the performance of the proposed supplementary damping controller.

[1]  Francisco de Leon,et al.  A Reconfigurable Auto-Loop Microgrid , 2015, IEEE Transactions on Power Delivery.

[2]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[3]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[4]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[5]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[6]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[7]  Michael L. Littman,et al.  Reinforcement learning improves behaviour from evaluative feedback , 2015, Nature.

[8]  T.C. Green,et al.  Energy Management in Autonomous Microgrid Using Stability-Constrained Droop Control of Inverters , 2008, IEEE Transactions on Power Electronics.

[9]  Zhong-Ping Jiang,et al.  Decentralized Adaptive Optimal Control of Large-Scale Systems With Application to Power Systems , 2015, IEEE Transactions on Industrial Electronics.

[10]  J.A.P. Lopes,et al.  Defining control strategies for MicroGrids islanded operation , 2006, IEEE Transactions on Power Systems.

[11]  John N. Tsitsiklis,et al.  Asynchronous stochastic approximation and Q-learning , 1994, Mach. Learn..

[12]  Yun Wei Li,et al.  An Accurate Power Control Strategy for Power-Electronics-Interfaced Distributed Generation Units Operating in a Low-Voltage Multibus Microgrid , 2009, IEEE Transactions on Power Electronics.

[13]  A.L. Dimeas,et al.  Operation of a multiagent system for microgrid control , 2005, IEEE Transactions on Power Systems.

[14]  P. Kundur,et al.  Power system stability and control , 1994 .

[15]  Boon-Teck Ooi,et al.  Damping power system oscillations by unidirectional control of alternative power generation plants , 2001, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[16]  Juan C. Vasquez,et al.  Hierarchical Control of Droop-Controlled AC and DC Microgrids—A General Approach Toward Standardization , 2009, IEEE Transactions on Industrial Electronics.