A Survey on Smart Agent-Based Microgrids for Resilient/Self-Healing Grids

This paper presents an overview of our body of work on the application of smart control techniques for the control and management of microgrids (MGs). The main focus here is on the application of distributed multi-agent system (MAS) theory in multi-objective (MO) power management of MGs to find the Pareto-front of the MO power management problem. In addition, the paper presents the application of Nash bargaining solution (NBS) and the MAS theory to directly obtain the NBS on the Pareto-front. The paper also discusses the progress reported on the above issues from the literature. We also present a MG-based power system architecture for enhancing the resilience and self-healing of the system.

[1]  Kaveh Dehghanpour,et al.  Agent-Based Modeling in Electrical Energy Markets Using Dynamic Bayesian Networks , 2016, IEEE Transactions on Power Systems.

[2]  Wenxin Liu,et al.  Distributed Dynamic Programming-Based Approach for Economic Dispatch in Smart Grids , 2015, IEEE Transactions on Industrial Informatics.

[3]  Ratnesh K. Sharma,et al.  Improving Sustainability of Hybrid Energy Systems Part I: Incorporating Battery Round-Trip Efficiency and Operational Cost Factors , 2014, IEEE Transactions on Sustainable Energy.

[4]  S. Ali Pourmousavi,et al.  Real-Time Central Demand Response for Primary Frequency Regulation in Microgrids , 2012, IEEE Transactions on Smart Grid.

[5]  Wei Zhang,et al.  Online Optimal Generation Control Based on Constrained Distributed Gradient Algorithm , 2015, IEEE Transactions on Power Systems.

[6]  Shao De-jun.  Review on the Wide Area Blackout of 500 kV Main Power Grid in Some Areas of South China in 2008 Snow Disaster , 2008 .

[7]  A.L. Dimeas,et al.  Operation of a multiagent system for microgrid control , 2005, IEEE Transactions on Power Systems.

[8]  Bin Liu,et al.  Multi-Agent Based Hierarchical Hybrid Control for Smart Microgrid , 2013, IEEE Transactions on Smart Grid.

[9]  Jason R. Marden,et al.  Decoupling Coupled Constraints Through Utility Design , 2014, IEEE Transactions on Automatic Control.

[10]  J. Romero.  Blackouts illuminate India's power problems , 2012 .

[11]  S. Ali Pourmousavi,et al.  Multi-Timescale Power Management for Islanded Microgrids Including Storage and Demand Response , 2015, IEEE Transactions on Smart Grid.

[12]  Jereme Haack,et al.  Volttron: an agent platform for the smart grid , 2013, AAMAS.

[13]  Enrico Pontelli,et al.  Improving DPOP with Branch Consistency for Solving Distributed Constraint Optimization Problems , 2014, CP.

[14]  Mehdi Savaghebi,et al.  Operation Cost Minimization of Droop-Controlled AC Microgrids Using Multiagent-Based Distributed Control , 2016 .

[15]  Enrico Pontelli,et al.  Multi-Variable Agents Decomposition for DCOPs , 2016, AAAI Conference on Artificial Intelligence.

[16]  M. H. Nehrir,et al.  Comprehensive Real-Time Microgrid Power Management and Control With Distributed Agents , 2013, IEEE Transactions on Smart Grid.

[17]  T. Nagata,et al.  A Multiagent Approach to Power System Restoration , 2002, IEEE Power Engineering Review.

[18]  S. X. Chen,et al.  Multi-Agent System for Distributed Management of Microgrids , 2015, IEEE Transactions on Power Systems.

[19]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[20]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[21]  José M. F. Moura,et al.  Cooperative Convex Optimization in Networked Systems: Augmented Lagrangian Algorithms With Directed Gossip Communication , 2010, IEEE Transactions on Signal Processing.

[22]  Juan C. Vasquez,et al.  Aalborg Universitet Next-Generation Shipboard DC Power System Introduction Smart Grid and dc Microgrid Technologies into Maritime Electrical Networks , 2016 .

[23]  S. Widergren,et al.  Smart grid interoperability maturity model , 2010, IEEE PES General Meeting.

[24]  Huiru Zhao,et al.  Application of a Gradient Descent Continuous Actor-Critic Algorithm for Double-Side Day-Ahead Electricity Market Modeling , 2016 .

[25]  I. Erlich,et al.  Online optimal management of PEMFuel cells using neural networks , 2005, IEEE Transactions on Power Delivery.

[26]  C.M. Colson,et al.  Distributed multi-agent microgrids: a decentralized approach to resilient power system self-healing , 2011, 2011 4th International Symposium on Resilient Control Systems.

[27]  Kaveh Dehghanpour,et al.  Agent-Based Modeling of Retail Electrical Energy Markets With Demand Response , 2018, IEEE Transactions on Smart Grid.

[28]  Tingwen Huang,et al.  Cooperative Distributed Optimization in Multiagent Networks With Delays , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  Minjie Zhang,et al.  A Multi-Agent Solution to Distribution System Management by Considering Distributed Generators , 2013, IEEE Transactions on Power Systems.

[30]  Hailong Wang,et al.  A Distributed Control Strategy for Frequency Regulation in Smart Grids Based on the Consensus Protocol , 2015 .

[31]  Johan A. K. Suykens,et al.  Application of a Smoothing Technique to Decomposition in Convex Optimization , 2008, IEEE Transactions on Automatic Control.

[32]  Boi Faltings,et al.  A Scalable Method for Multiagent Constraint Optimization , 2005, IJCAI.

[33]  David A. Cartes,et al.  Distributed energy resource management in a smart grid by risk based auction strategy for profit maximization , 2010, IEEE PES General Meeting.

[34]  Nicanor Quijano,et al.  Distributed Population Dynamics: Optimization and Control Applications , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Andreas Sumper,et al.  Probabilistic Agent-Based Model of Electric Vehicle Charging Demand to Analyse the Impact on Distribution Networks , 2015 .

[36]  S. J. Ranade,et al.  Optimum operation of a customer-driven microgrid: A comprehensive approach , 2012, 2012 IEEE International Conference on Power Electronics, Drives and Energy Systems (PEDES).

[37]  Huiping Li,et al.  Robust Receding Horizon Control for Networked and Distributed Nonlinear Systems , 2016 .

[38]  M. Pipattanasomporn,et al.  A multi-agent system for restoration of an electric power distribution network with local generation , 2012, 2012 IEEE Power and Energy Society General Meeting.

[39]  Milos S. Stankovic,et al.  Distributed Seeking of Nash Equilibria With Applications to Mobile Sensor Networks , 2012, IEEE Transactions on Automatic Control.

[40]  M. Abido.  Environmental/economic power dispatch using multiobjective evolutionary algorithms , 2003, 2003 IEEE Power Engineering Society General Meeting (IEEE Cat. No.03CH37491).

[41]  S. Gass,et al.  Linear Programming: Methods and Applications. , 1960 .

[42]  Andres Pantoja,et al.  Dispatch of distributed generators under local-information constraints , 2014, 2014 American Control Conference.

[43]  J. Jatskevich,et al.  Power Quality Control of Wind-Hybrid Power Generation System Using Fuzzy-LQR Controller , 2007, IEEE Transactions on Energy Conversion.

[44]  Palak Jain,et al.  Island identification in customer-driven micro-grids , 2010, IEEE PES T&D 2010.

[45]  M. Velez-Reyes,et al.  Hierarchical control of Hybrid Power Systems , 2008, 2008 11th IEEE International Power Electronics Congress.

[46]  Il-Yop Chung,et al.  Multi-Agent System-Based Microgrid Operation Strategy for Demand Response , 2015 .

[47]  F. Valenciaga,et al.  Supervisor control for a stand-alone hybrid generation system using wind and photovoltaic energy , 2005, IEEE Transactions on Energy Conversion.

[48]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[49]  Jason R. Marden,et al.  Game Theory and Distributed Control , 2015 .

[50]  Ratnesh K. Sharma,et al.  Improving Sustainability of Hybrid Energy Systems Part II: Managing Multiple Objectives With a Multiagent System , 2014, IEEE Transactions on Sustainable Energy.

[51]  Yinliang Xu,et al.  Distributed Optimal Resource Management Based on the Consensus Algorithm in a Microgrid , 2015, IEEE Transactions on Industrial Electronics.

[52]  H.M. Faheem,et al.  It takes a multiagent system to manage distributed systems , 2007, IEEE Potentials.

[53]  Minjie Zhang,et al.  Conceptual Design of A Multi-Agent System for Interconnected Power Systems Restoration , 2012, IEEE Transactions on Power Systems.

[54]  Ahmed M. Azmy,et al.  Online optimal management of PEM fuel cells using neural networks , 2005 .

[55]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[56]  Tang Bao-sheng.  BLACKOUT IN SOUTH OF LONDON AND ITS LESSONS , 2003 .

[57]  Ping Yang,et al.  Control devices development of multi-microgrids based on hierarchical structure , 2016 .

[58]  Satish J. Ranade,et al.  Capacity Discovery in customer-driven micro-grids , 2009, 41st North American Power Symposium.

[59]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[60]  Nicanor Quijano,et al.  Population Games Methods for Distributed Control of Microgrids , 2015, IEEE Transactions on Smart Grid.

[61]  Jason R. Marden,et al.  Designing Games for Distributed Optimization , 2013, IEEE J. Sel. Top. Signal Process..

[62]  Andres Pantoja,et al.  A Population Dynamics Approach for the Dispatch of Distributed Generators , 2011, IEEE Transactions on Industrial Electronics.

[63]  Saurabh Gupta,et al.  Modeling microgrid islanding problems as DCOPs , 2013, 2013 North American Power Symposium (NAPS).

[64]  Ernane Antonio Alves Coelho,et al.  Review of Active and Reactive Power Sharing Strategies in Hierarchical Controlled Microgrids , 2017, IEEE Transactions on Power Electronics.

[65]  Amin Hajizadeh,et al.  Fuzzy neural control of a hybrid fuel cell/battery distributed power generation system , 2009 .

[66]  Toshiyuki Sueyoshi,et al.  Why Did California Electricity Crisis Occur? a Numerical Analysis Using Multiagent Intelligent Simulator Abstract—during the Summer (2000), Wholesale Electricity Fits of Competition Promised to Consumers. This Study Proposes a Use of a Multiagent Intelligent Simulator (mais) to Numerically Ex- Amine , 2022 .

[67]  Ken Nagasaka,et al.  Multiobjective Intelligent Energy Management for a Microgrid , 2013, IEEE Transactions on Industrial Electronics.

[68]  Angelia Nedic,et al.  Asynchronous Broadcast-Based Convex Optimization Over a Network , 2011, IEEE Transactions on Automatic Control.

[69]  Deming Yuan,et al.  Distributed Primal-Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms. , 2011, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society.

[70]  Yi Peng,et al.  Design games to solve distributed optimization problem with application in electric vehicle charge management , 2013, Proceedings of the 32nd Chinese Control Conference.

[71]  Miao Yu,et al.  A game theoretic approach for the distributed control of multi-agent systems under directed and time-varying topology , 2014 .

[72]  Kaveh Dehghanpour,et al.  Agent-based modeling in electrical energy markets using dynamic Bayesian networks , 2017, 2017 IEEE Power & Energy Society General Meeting.

[73]  Liuchen Chang,et al.  Multiagent-Based Hybrid Energy Management System for Microgrids , 2014, IEEE Transactions on Sustainable Energy.

[74]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[75]  Geza Joos,et al.  Multiobjective Optimization Dispatch for Microgrids With a High Penetration of Renewable Generation , 2015, IEEE Transactions on Sustainable Energy.

[76]  Ion Necoara,et al.  Parallel and distributed optimization methods for estimation and control in networks , 2011, 1302.3103.

[77]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[78]  Ali H. Sayed,et al.  Distributed Pareto Optimization via Diffusion Strategies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[79]  Jeremy Lagorse,et al.  A Multiagent Fuzzy-Logic-Based Energy Management of Hybrid Systems , 2009 .

[80]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[81]  Caisheng Wang,et al.  Power Management of a Stand-Alone Wind/Photovoltaic/Fuel Cell Energy System , 2008, IEEE Transactions on Energy Conversion.

[82]  Kai Huang,et al.  A Multiagent-Based Algorithm for Ring-Structured Shipboard Power System Reconfiguration , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[83]  Bo Zhao,et al.  Operation Optimization of Standalone Microgrids Considering Lifetime Characteristics of Battery Energy Storage System , 2013, IEEE Transactions on Sustainable Energy.

[84]  Wenxin Liu,et al.  Distributed Online Optimal Energy Management for Smart Grids , 2015, IEEE Transactions on Industrial Informatics.

[85]  J. Fitch,et al.  A Multi-Agent Framework for Power System Automation , .

[86]  Kaveh Dehghanpour,et al.  Real-Time Multiobjective Microgrid Power Management Using Distributed Optimization in an Agent-Based Bargaining Framework , 2018, IEEE Transactions on Smart Grid.