Ensemble learning for optimal active power control of distributed energy resources and thermostatically controlled loads in an islanded microgrid

Abstract To achieve an effective coordination between the secondary control and the tertiary control of load frequency control (LFC), a new optimal active power control (OAPC) is constructed for real-timely changing the operating points of distributed energy resources (DERs) and thermostatically controlled loads (TCLs) in an islanded microgrid. A large number of TCLs are integrated as a load aggregator (LA) for participating the secondary control of LFC, which can enhance the dynamic response performance due to their much faster response speeds compared with that of distributed generators. Since OAPC is a nonsmooth and nonlinear optimization with a quite short implementation period, a novel model-free ensemble learning (EL) is proposed to rapidly obtain a high-quality optimal solution for it. EL based OAPC is composed of multiple sub-optimizers and a learning concentrator, where each sub-optimizer is responsible for providing the exploitation and exploration samples to the learning concentrator, while the reinforcement learning based concentrator is mainly used for knowledge learning and knowledge transfer. Case studies are thoroughly carried out to verify the performance of EL based OAPC in an islanded microgrid with 12 DERs and 900 TCLs.

[1]  Yu Xichang,et al.  Practical implementation of the SCADA+AGC/ED system of the hunan power pool in the central China power network , 1994 .

[2]  Kay Chen Tan,et al.  A New Differential Evolution Algorithm for Minimax Optimization in Robust Design , 2018, IEEE Transactions on Cybernetics.

[3]  Zhihua Qu,et al.  Distributed Real-Time Optimal Power Flow Control in Smart Grid , 2017, IEEE Transactions on Power Systems.

[4]  Tao Yu,et al.  Deep transfer Q-learning with virtual leader-follower for supply-demand Stackelberg game of smart grid , 2017 .

[5]  Peter Xiaoping Liu,et al.  Impact of Communication Delays on Secondary Frequency Control in an Islanded Microgrid , 2015, IEEE Transactions on Industrial Electronics.

[6]  Georgios A. Vokas,et al.  Optimal management of hydrogen storage in stochastic smart microgrid operation , 2018 .

[7]  Shin'ya Obara,et al.  Operation planning of an independent microgrid for cold regions by the distribution of fuel cells an , 2011 .

[8]  Reinaldo A. C. Bianchi,et al.  Transferring knowledge as heuristics in reinforcement learning: A case-based approach , 2015, Artif. Intell..

[9]  Tao Yu,et al.  Consensus Transfer ${Q}$ -Learning for Decentralized Generation Command Dispatch Based on Virtual Generation Tribe , 2018, IEEE Transactions on Smart Grid.

[10]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[11]  Issarachai Ngamroo,et al.  Coordinated Control of Wind Turbine Blade Pitch Angle and PHEVs Using MPCs for Load Frequency Control of Microgrid , 2016, IEEE Systems Journal.

[12]  N. Kumarappan,et al.  Autonomous operation and control of photovoltaic/solid oxide fuel cell/battery energy storage based microgrid using fuzzy logic controller , 2016 .

[13]  Josep M. Guerrero,et al.  Improving Frequency Stability Based on Distributed Control of Multiple Load Aggregators , 2017, IEEE Transactions on Smart Grid.

[14]  Zhao Xu,et al.  Demand as Frequency Controlled Reserve , 2011, IEEE Transactions on Power Systems.

[15]  Bo Yang,et al.  Accelerating bio-inspired optimizer with transfer reinforcement learning for reactive power optimization , 2017, Knowl. Based Syst..

[16]  Xuesong Wang,et al.  Multi-source transfer ELM-based Q learning , 2014, Neurocomputing.

[17]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[18]  Hassan Bevrani,et al.  Robust Frequency Control in an Islanded Microgrid: H∞ and μ-Synthesis Approaches , 2016, IEEE Trans. Smart Grid.

[19]  Mattia Marinelli,et al.  Provision of secondary frequency control via demand response activation on thermostatically controlled loads: Solutions and experiences from Denmark , 2016 .

[20]  E.F. El-Saadany,et al.  Adaptive Decentralized Droop Controller to Preserve Power Sharing Stability of Paralleled Inverters in Distributed Generation Microgrids , 2008, IEEE Transactions on Power Electronics.

[21]  Djamel Boukhetala,et al.  Hierarchical control for flexible microgrid based on three-phase voltage source inverters operated in parallel , 2018 .

[22]  Eung-Sang Kim,et al.  Distributed Generation Control Method for Active Power Sharing and Self-Frequency Recovery in an Islanded Microgrid , 2017, IEEE Transactions on Power Systems.

[23]  Georgios A. Vokas,et al.  Electric vehicle charging in stochastic smart microgrid operation with fuel cell and RES units , 2017 .

[24]  Yu Xichang,et al.  Practical implementation of the SCADA+AGC/ED system of the hunan power pool in the central China power network , 1994, IEEE Power Engineering Review.

[25]  Mohamed I. Mosaad,et al.  Power quality enhancement of grid-connected fuel cell using evolutionary computing techniques , 2018, International Journal of Hydrogen Energy.

[26]  S. Kahla,et al.  Particle swarm optimization based sliding mode control of variable speed wind energy conversion system , 2016 .

[27]  Somyot Kaitwanidvilai,et al.  Application of electrolyzer system to enhance frequency stabilization effect of microturbine in a microgrid system , 2009 .

[28]  Jidong Wang,et al.  Interval number optimization for household load scheduling with uncertainty , 2016 .

[29]  Juan C. Vasquez,et al.  Hierarchical Control of Droop-Controlled AC and DC Microgrids—A General Approach Toward Standardization , 2009, IEEE Transactions on Industrial Electronics.

[30]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[31]  Marcelo G. Molina,et al.  Stabilization and control of tie-line power flow of microgrid including wind generation by distributed energy storage , 2010 .

[32]  Malabika Basu,et al.  Group search optimization for combined heat and power economic dispatch , 2016 .

[33]  Saifur Rahman,et al.  Development of physical-based demand response-enabled residential load models , 2013, IEEE Transactions on Power Systems.

[34]  Sajeeb Saha,et al.  Robust multiobjective control method for power sharing among distributed energy resources in islanded microgrids with unbalanced and nonlinear loads , 2018 .

[35]  Gavin Brown,et al.  Ensemble Learning , 2010, Encyclopedia of Machine Learning and Data Mining.

[36]  Mohammad Chehreghani Bozchalui Optimal Operation of Energy Hubs in the Context of Smart Grids , 2011 .

[37]  Ushnik Mukherjee,et al.  Techno-economic, environmental, and safety assessment of hydrogen powered community microgrids; case study in Canada , 2017 .

[38]  Ahad Kazemi,et al.  Optimal design of solar PV-WT-SB based smart microgrid using NSHCSO , 2016 .

[39]  Xiao Hu,et al.  A Novel Frequency and Voltage Control Method for Islanded Microgrid Based on Multienergy Storages , 2016, IEEE Transactions on Smart Grid.

[40]  Sukumar Mishra,et al.  Storage Free Smart Energy Management for Frequency Control in a Diesel-PV-Fuel Cell-Based Hybrid AC Microgrid , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[41]  Georgios A. Vokas,et al.  Effect of fuel cell units in economic and environmental dispatch of a Microgrid with penetration of photovoltaic and micro turbine units , 2017 .