A wolf pack hunting strategy based virtual tribes control for automatic generation control of smart grid

This paper proposes a novel electric power autonomy to satisfy the requirement of power generation optimization of smart grid and decentralized energy management system. A decentralized virtual tribes control (VTC) is developed which can effectively coordinate the regional dispatch centre and the distributed energy. Then a wolf pack hunting (WPH) strategy based VTC (WPH-VTC) is designed through combining the multi-agent system stochastic game and multi-agent system collaborative consensus, which is called the multi-agent system stochastic consensus game, to achieve the coordination and optimization of the decentralized VTC, such that different types of renewable energy can be effectively integrated into the electric power autonomy. The proposed scheme is implemented on a flexible and dynamic multi-agent stochastic game-based VTC simulation platform, which control performance is evaluated on a typical two-area load–frequency control power system and a practical Guangdong power grid model in southern China. Simulation results verify that it can improve the closed-loop system performances, increase the utilization rate of the renewable energy, reduce the carbon emissions, and achieve a fast convergence rate with significant robustness compared with those of existing schemes.

[1]  Tomonobu Senjyu,et al.  An integrated control method for a wind farm to reduce frequency deviations in a small power system , 2011 .

[2]  Kincho H. Law,et al.  A data-driven, cooperative wind farm control to maximize the total power production , 2016 .

[3]  Jianhui Wang,et al.  Data-Driven Real-Time Power Dispatch for Maximizing Variable Renewable Generation , 2016, ArXiv.

[4]  Lei Xi,et al.  A novel multi-agent decentralized win or learn fast policy hill-climbing with eligibility trace algorithm for smart generation control of interconnected complex power grids☆ , 2015 .

[5]  Mattia Marinelli,et al.  Provision of secondary frequency control via demand response activation on thermostatically controlled loads: Solutions and experiences from Denmark , 2016 .

[6]  Randal W. Beard,et al.  Distributed Consensus in Multi-vehicle Cooperative Control - Theory and Applications , 2007, Communications and Control Engineering.

[7]  Kai Tang,et al.  An optimal time-of-use pricing for urban gas: A study with a multi-agent evolutionary game-theoretic perspective , 2016 .

[8]  J. Nash,et al.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[9]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[10]  Kashem M. Muttaqi,et al.  Optimizing distributed generation parameters through economic feasibility assessment , 2016 .

[11]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[12]  Ville Könönen,et al.  Dynamic pricing based on asymmetric multiagent reinforcement learning , 2006, Int. J. Intell. Syst..

[13]  Lei Xi,et al.  Multiagent Stochastic Dynamic Game for Smart Generation Control , 2016 .

[14]  Siddharth Suryanarayanan,et al.  A flexible and efficient multi-agent gas turbine power plant energy management system with economic and environmental constraints , 2013 .

[15]  Alberto Giretti,et al.  SEAM4US: an intelligent energy management system for underground stations , 2016 .

[16]  Vitor Nazário Coelho,et al.  A self-adaptive evolutionary fuzzy model for load forecasting problems on smart grid environment , 2016 .

[17]  Khosrow Moslehi,et al.  Power System Control Centers: Past, Present, and Future , 2005, Proceedings of the IEEE.

[18]  Tao Yu,et al.  Strength Pareto Multigroup Search Optimizer for Multiobjective Optimal Reactive Power Dispatch , 2014, IEEE Transactions on Industrial Informatics.

[19]  Tao Yu,et al.  Stochastic Optimal Relaxed Automatic Generation Control in Non-Markov Environment Based on Multi-Step $Q(\lambda)$ Learning , 2011, IEEE Transactions on Power Systems.

[20]  Tao Yu,et al.  Stochastic Optimal CPS Relaxed Control Methodology for Interconnected Power Systems Using Q-Learning Method , 2011 .

[21]  Victor M. Zavala,et al.  Large-scale optimal control of interconnected natural gas and electrical transmission systems , 2016 .

[22]  Tao Yu,et al.  Distributed multi-step Q(λ) learning for Optimal Power Flow of large-scale power grids , 2012 .

[23]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[24]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[25]  Tao Yu,et al.  Stochastic optimal generation command dispatch based on improved hierarchical reinforcement learning approach , 2011 .

[26]  Bo Zhao,et al.  An MAS based energy management system for a stand-alone microgrid at high altitude , 2015 .

[27]  Hongbin Sun,et al.  Family of energy management system for smart grid , 2012, 2012 3rd IEEE PES Innovative Smart Grid Technologies Europe (ISGT Europe).

[28]  Khizir Mahmud,et al.  A review of computer tools for modeling electric vehicle energy requirements and their impact on power distribution networks , 2016 .

[29]  Stein W. Wallace,et al.  Synergy of smart grids and hybrid distributed generation on the value of energy storage , 2016 .

[30]  Tao Yu,et al.  Equilibrium-Inspired Multiple Group Search Optimization With Synergistic Learning for Multiobjective Electric Power Dispatch , 2013, IEEE Transactions on Power Systems.

[31]  Keith B. Hall,et al.  Correlated Q-Learning , 2003, ICML.

[32]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[33]  Danny Pudjianto,et al.  Virtual power plant and system integration of distributed energy resources , 2007 .

[34]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[35]  Shengwei Mei,et al.  Distributionally robust hydro-thermal-wind economic dispatch , 2016 .

[36]  Naomi Ehrich Leonard,et al.  Virtual leaders, artificial potentials and coordinated control of groups , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[37]  Jiangping Hu,et al.  Leader-following coordination of multi-agent systems with coupling time delays , 2007, 0705.0401.

[38]  L. Conradt,et al.  Consensus decision making in animals. , 2005, Trends in ecology & evolution.

[39]  Goshaidas Ray,et al.  A new approach to the design of robust load-frequency controller for large scale power systems , 1999 .

[40]  N. Jaleeli,et al.  NERC's new control performance standards , 1999 .

[41]  Lingfeng Wang,et al.  Multi-agent control system with information fusion based comfort model for smart buildings , 2012 .

[42]  Domenico Prattichizzo,et al.  Discussion of paper by , 2003 .

[43]  Li Li,et al.  Virtual generation tribe based robust collaborative consensus algorithm for dynamic generation command dispatch optimization of smart grid , 2016 .

[44]  Yasunori Mitani,et al.  A new load frequency control approach in an isolated small power systems using coefficient diagram method , 2014 .

[45]  Anjan Bose,et al.  Smart Transmission Grid Applications and Their Supporting Infrastructure , 2010, IEEE Transactions on Smart Grid.

[46]  Tao Yu,et al.  R(λ) imitation learning for automatic generation control of interconnected power grids , 2012, Autom..

[47]  Vijay Vittal,et al.  Self-healing in power systems: an approach using islanding and rate of frequency decline-based load shedding , 2002 .

[48]  S. Biswas,et al.  Pareto-efficient double auction power transactions for economic reactive power dispatch , 2016 .

[49]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.