Survey of multi-agent systems for microgrid control

Multi-agent systems (MAS) consist of multiple intelligent agents that interact to solve problems that may be beyond the capabilities of a single agent or system. For many years, conceptual MAS designs and architectures have been proposed for applications in power systems and power engineering. With the increasing use and modeling of distributed energy resources for microgrid applications, MAS are well suited to manage the size and complexity of these energy systems. The purpose of this paper is to survey applications of MAS in the control and operation of microgrids. The paper will review MAS concepts, architectures, develop platforms and processes, provide example applications, and discuss limitations.

[1]  Taha Selim Ustun,et al.  Recent developments in microgrids and example cases around the world—A review , 2011 .

[2]  Yang Jun,et al.  Multi-agent Development Toolkits: An Evaluation , 2004, IEA/AIE.

[3]  Gu Wei Active power and frequency control of islanded microgrid based on multi-agent technology , 2009 .

[4]  Anil Pahwa,et al.  Game theoretic model of energy trading strategies at equilibrium in microgrids , 2014, 2014 North American Power Symposium (NAPS).

[5]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[6]  Hyacinth S. Nwana,et al.  ZEUS: a toolkit and approach for building distributed multi-agent systems , 1999, AGENTS '99.

[7]  M.P.F. Hommelberg,et al.  Distributed Control Concepts using Multi-Agent technology and Automatic Markets: An indispensable feature of smart power grids , 2007, 2007 IEEE Power Engineering Society General Meeting.

[8]  Steven T. Bushby,et al.  BACnetTM: a standard communication infrastructure for intelligent buildings , 1997 .

[9]  Houlei Gao,et al.  Multi-agent based fault location algorithm for smart distribution grid , 2010 .

[10]  Jiang Yu,et al.  Control system simulation of microgrid based on IP and Multi-Agent , 2010, 2010 International Conference on Information, Networking and Automation (ICINA).

[11]  Nikos D. Hatziargyriou,et al.  A Multi-agent System for Microgrids , 2004, SETN.

[12]  Peter Mendham,et al.  MACSimJX: a tool for enabling agent modelling with Simulink using JADE , 2010 .

[13]  Amro M. Farid,et al.  Multi-Agent System Design Principles for Resilient Coordination & Control of Future Power Systems , 2015 .

[14]  Sompob Polmai,et al.  Experiment on distributed cooperative control with multi-agent system for a single-phase microgrid , 2015, 2015 12th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[15]  Lopez,et al.  Selecting a multi-agent system development tool for industrial applications: A case study of self-serving aircraft assets , 2010 .

[16]  Bin Song,et al.  Multi-agent approach for service restoration of microgrid , 2010, 2010 5th IEEE Conference on Industrial Electronics and Applications.

[17]  M. H. Nehrir,et al.  Comprehensive Real-Time Microgrid Power Management and Control With Distributed Agents , 2013, IEEE Transactions on Smart Grid.

[18]  Xia Shen,et al.  System Service Restoration of Distribution Network Based on Multi-agent Technology , 2013, 2013 Fourth International Conference on Digital Manufacturing & Automation.

[19]  Manuela M. Veloso,et al.  Multiagent Systems: A Survey from a Machine Learning Perspective , 2000, Auton. Robots.

[20]  J.R. McDonald,et al.  Applying multi-agent system technology in practice: automated management and analysis of SCADA and digital fault recorder data , 2006, 2006 IEEE Power Engineering Society General Meeting.

[21]  A.L. Dimeas,et al.  Operation of a multiagent system for microgrid control , 2005, IEEE Transactions on Power Systems.

[22]  Nick Miller,et al.  The Grid of the Future: Ten Trends That Will Shape the Grid Over the Next Decade , 2014, IEEE Power and Energy Magazine.

[23]  Jereme Haack,et al.  VOLTTRON: An Agent Execution Platform for the Electric Power System , 2012 .

[24]  Chen Chen,et al.  Coordinated energy management of networked Microgrids in distribution systems , 2015 .

[25]  N. D. Hatziargyriou,et al.  Multi-agent reinforcement learning for microgrids , 2010, IEEE PES General Meeting.

[26]  T. S. Sidhu,et al.  Design and Implementation of Multiagent-Based Distributed Restoration System in DAS , 2013, IEEE Transactions on Power Delivery.

[27]  Takeshi Nagata,et al.  Electric power interchange between micro-grids by using multi-agent approach , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[28]  Isabel Praça,et al.  Mascem: A Multiagent System That Simulates Competitive Electricity Markets , 2003, IEEE Intell. Syst..

[29]  Omer F. Rana,et al.  What is scalability in multi-agent systems? , 2000, AGENTS '00.

[30]  N. D. Hatziargyriou,et al.  Control Agents for Real Microgrids , 2009, 2009 15th International Conference on Intelligent System Applications to Power Systems.

[31]  Lucia Gauchia,et al.  Scoping Study: Networked Microgrids , 2014 .

[32]  Maurizio Cirrincione,et al.  A multi-agent architecture for simulating and managing microgrids , 2011, 2011 Federated Conference on Computer Science and Information Systems (FedCSIS).

[33]  Thillainathan Logenthiran,et al.  Multiagent System for Real-Time Operation of a Microgrid in Real-Time Digital Simulator , 2012, IEEE Transactions on Smart Grid.

[34]  R. Yokoyama,et al.  An autonomous agent for reliable operation of power market and systems including microgrids , 2008, 2008 Third International Conference on Electric Utility Deregulation and Restructuring and Power Technologies.

[35]  N.N. Schulz,et al.  A Multi-Agent Solution to Distribution Systems Restoration , 2007, IEEE Transactions on Power Systems.

[36]  Joydeep Mitra,et al.  A hierarchical multi-agent control scheme for a black start-capable microgrid , 2011, 2011 IEEE Power and Energy Society General Meeting.

[37]  A.L. Dimeas,et al.  A MAS architecture for microgrids control , 2005, Proceedings of the 13th International Conference on, Intelligent Systems Application to Power Systems.

[38]  Derek W. Bunn,et al.  Evaluating Individual Market Power in Electricity Markets via Agent-Based Simulation , 2003, Ann. Oper. Res..

[39]  Haritza Camblong,et al.  Multi-agent systems for the dependability and safety of microgrids , 2014, International Journal on Interactive Design and Manufacturing (IJIDeM).

[40]  Pedro Faria,et al.  Distributed intelligent management of microgrids using a multi-agent simulation platform , 2014, 2014 IEEE Symposium on Intelligent Agents (IA).

[41]  Guping Zheng,et al.  Multi-Agent Based Control System for Multi-Microgrids , 2010, 2010 International Conference on Computational Intelligence and Software Engineering.

[42]  T. Nagata,et al.  A Multiagent Approach to Power System Restoration , 2002, IEEE Power Engineering Review.

[43]  Thillainathan Logenthiran,et al.  Multi-agent system for energy resource scheduling of integrated microgrids in a distributed system , 2011 .

[44]  M. K. Kouluri,et al.  Intelligent agent based micro grid control , 2011, 2011 2nd International Conference on Intelligent Agent & Multi-Agent Systems.

[45]  Foo Y. S. Eddy,et al.  Multi-agent system for optimization of microgrids , 2011, 8th International Conference on Power Electronics - ECCE Asia.

[46]  Ernest Orlando Lawrence The CERTS Microgrid and the Future of the Macrogrid , 2004 .

[47]  Athula D. Rajapakse,et al.  Microgrids research: A review of experimental microgrids and test systems , 2011 .

[48]  Kamal Youcef-Toumi,et al.  A multi-agent system transient stability platform for resilient self-healing operation of multiple microgrids , 2014, ISGT 2014.

[49]  Daniel J. Veit,et al.  A Critical Survey of Agent-Based Wholesale Electricity Market Models , 2008 .

[50]  Hadi Saadat,et al.  Power System Analysis , 1998 .

[51]  Liuchen Chang,et al.  Multiagent-Based Hybrid Energy Management System for Microgrids , 2014, IEEE Transactions on Sustainable Energy.

[52]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[53]  M. Genoese,et al.  Agent-based simulation of electricity markets: a literature review , 2007 .

[54]  Sarvapali D. Ramchurn,et al.  Agent-based micro-storage management for the Smart Grid , 2010, AAMAS.

[55]  Ali Feliachi,et al.  Multi Agent System based fault location and isolation in a smart microgrid system , 2012, 2012 IEEE PES Innovative Smart Grid Technologies (ISGT).

[56]  Stephen Cranefield,et al.  Platforms for agent-oriented software , 2000 .

[57]  Wenxin Liu,et al.  Novel Multiagent Based Load Restoration Algorithm for Microgrids , 2011, IEEE Transactions on Smart Grid.

[58]  Hans Akkermans,et al.  Decentralized Markets versus Central Control: A Comparative Study , 1999, J. Artif. Intell. Res..

[59]  W.H. Tang,et al.  An agent brokering-based scheme for anti-islanding protection of distributed generation , 2009, 2009 IEEE Power & Energy Society General Meeting.

[60]  Kehe Wu,et al.  A multi-agent-based energy-coordination control system for grid-connected large-scale wind–photovoltaic energy storage power-generation units , 2014 .

[61]  Agostino Poggi,et al.  Developing multi‐agent systems with a FIPA‐compliant agent framework , 2001 .

[62]  Ratnesh K. Sharma,et al.  Improving Sustainability of Hybrid Energy Systems Part II: Managing Multiple Objectives With a Multiagent System , 2014, IEEE Transactions on Sustainable Energy.

[63]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[64]  Zhang Jian,et al.  The application of multi agent system in microgrid coordination control , 2009, 2009 International Conference on Sustainable Power Generation and Supply.

[65]  M. Ventosa,et al.  Electricity market modeling trends , 2005 .

[66]  Hany E. Farag,et al.  A multilayer control framework for distribution systems with high DG penetration , 2011, 2011 International Conference on Innovations in Information Technology.

[67]  Nick Jenkins,et al.  Introducing electric vehicles in the microgrids concept , 2011, 2011 16th International Conference on Intelligent System Applications to Power Systems.

[68]  J. Oyarzabal,et al.  Agent based micro grid management system , 2005, 2005 International Conference on Future Power Systems.

[69]  Jingjing Yang,et al.  Hierarchical MAS Based Control Strategy for Microgrid , 2010 .

[70]  Rui Duan,et al.  Multi-agent coordination in market environment for future electricity infrastructure based on microgrids , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[71]  Weihua Zhuang,et al.  Multiagent coordination in microgrids via wireless networks , 2012, IEEE Wireless Communications.

[72]  M. Pipattanasomporn,et al.  Multi-agent systems in a distributed smart grid: Design and implementation , 2009, 2009 IEEE/PES Power Systems Conference and Exposition.

[73]  S.D.J. McArthur,et al.  Multi-Agent Systems for Power Engineering Applications—Part I: Concepts, Approaches, and Technical Challenges , 2007, IEEE Transactions on Power Systems.

[74]  C.M. Colson,et al.  A review of challenges to real-time power management of microgrids , 2009, 2009 IEEE Power & Energy Society General Meeting.

[75]  José M. Molina López,et al.  A Multi-Agent architecture for intelligent gathering systems , 2005, AI Communications.

[76]  Steven L. Lytinen,et al.  Agent-based Simulation Platforms: Review and Development Recommendations , 2006, Simul..

[77]  Robert H. Lasseter,et al.  Microgrids And Distributed Generation , 2007, Intell. Autom. Soft Comput..

[78]  S. M. Moghaddas-Tafreshi,et al.  A review on operation of micro grids and Virtual Power Plants in the power markets , 2009, 2009 2nd International Conference on Adaptive Science & Technology (ICAST).

[79]  N. Hatziargyriou,et al.  Making microgrids work , 2008, IEEE Power and Energy Magazine.

[80]  Zhenhua Jiang,et al.  Agent-Based Control Framework for Distributed Energy Resources Microgrids , 2006, 2006 IEEE/WIC/ACM International Conference on Intelligent Agent Technology.

[81]  Nicolas Lhuillier,et al.  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS , 2003 .

[82]  J.R. McDonald,et al.  Applying multi-agent system technology in practice: automated management and analysis of SCADA and digital fault recorder data , 2006, IEEE Transactions on Power Systems.

[83]  Ali Feliachi,et al.  Smart MAS restoration for distribution system with Microgrids , 2013, 2013 IEEE Power & Energy Society General Meeting.

[84]  Bo Zhao,et al.  An MAS based energy management system for a stand-alone microgrid at high altitude , 2015 .

[85]  Jaime Lloret,et al.  A Survey on Electric Power Demand Forecasting: Future Trends in Smart Grids, Microgrids and Smart Buildings , 2014, IEEE Communications Surveys & Tutorials.

[86]  Takeshi Nagata,et al.  A multi-agent based optimal operation for microgrid , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[87]  Hak-Man Kim,et al.  Multiagent system for Microgrid operation based on power market environment , 2009, INTELEC 2009 - 31st International Telecommunications Energy Conference.

[88]  Anurag K. Srivastava,et al.  Controls for microgrids with storage: Review, challenges, and research needs , 2010 .

[89]  S. X. Chen,et al.  Multi-Agent System for Distributed Management of Microgrids , 2015, IEEE Transactions on Power Systems.

[90]  Wei Jiang,et al.  The Overview of Research on Microgrid Protection Development , 2010, 2010 International Conference on Intelligent System Design and Engineering Application.

[91]  R. A. R. C. Gopura,et al.  Dual layered multi agent system for intentional islanding operation of microgrids , 2012 .

[92]  Nicholas R. Jennings,et al.  On agent-based software engineering , 2000, Artif. Intell..

[93]  Lingfeng Wang,et al.  Intelligent multi-agent control for integrated building and micro-grid systems , 2011, ISGT 2011.

[94]  Chris Marnay,et al.  Integration of distributed energy resources. The CERTS Microgrid Concept , 2002 .

[95]  A.L. Dimeas,et al.  Agent based control of Virtual Power Plants , 2007, 2007 International Conference on Intelligent Systems Applications to Power Systems.

[96]  T. Pinto,et al.  Multiagent System Architecture for Short-term Operation of Integrated Microgrids , 2014 .

[97]  A.L. Dimeas,et al.  Development of an agent based intelligent control system for microgrids , 2008, 2008 IEEE Power and Energy Society General Meeting - Conversion and Delivery of Electrical Energy in the 21st Century.

[98]  Hak-Man Kim,et al.  A Multiagent System for Autonomous Operation of Islanded Microgrids Based on a Power Market Environment , 2010 .

[99]  Abder Koukam,et al.  Multi-agent systems for grid energy management: A short review , 2010, IECON 2010 - 36th Annual Conference on IEEE Industrial Electronics Society.

[100]  C. H. Wang,et al.  A Multi-Agent Based Service Restoration in Distribution Network with Distributed Generations , 2009, 2009 15th International Conference on Intelligent System Applications to Power Systems.

[101]  Xu Rong,et al.  A review on distributed energy resources and MicroGrid , 2008 .

[102]  C.M. Colson,et al.  Distributed multi-agent microgrids: a decentralized approach to resilient power system self-healing , 2011, 2011 4th International Symposium on Resilient Control Systems.

[103]  M. H. Nehrir,et al.  Multi-agent Microgrid Power Management , 2011 .

[104]  Suryanarayana Doolla,et al.  Multiagent-Based Distributed-Energy-Resource Management for Intelligent Microgrids , 2013, IEEE Transactions on Industrial Electronics.

[105]  F RailsbackSteven,et al.  Agent-based Simulation Platforms , 2006 .

[106]  Nicholas R. Jennings,et al.  Pitfalls of agent-oriented development , 1998, AGENTS '98.

[107]  Michael Wooldridge,et al.  Intelligent agents: theory and practice The Knowledge Engineering Review , 1995 .

[108]  T. Logenthiran,et al.  Agent-based intelligent control for real-time operation of a microgrid , 2010, 2010 Joint International Conference on Power Electronics, Drives and Energy Systems & 2010 Power India.

[109]  S.D.J. McArthur,et al.  Multi-Agent Systems for Power Engineering Applications—Part II: Technologies, Standards, and Tools for Building Multi-agent Systems , 2007, IEEE Transactions on Power Systems.

[110]  Charles M. Macal,et al.  E-laboratories : agent-based modeling of electricity markets. , 2002 .

[111]  Hak-Man Kim,et al.  An Intelligent Multiagent System for Autonomous Microgrid Operation , 2012 .

[112]  T. Logenthiran,et al.  Multi-agent coordination for DER in MicroGrid , 2008, 2008 IEEE International Conference on Sustainable Energy Technologies.

[113]  N. Hatziargyriou,et al.  Microgrids: an overview of ongoing research, development, anddemonstration projects , 2007 .

[114]  Hak-Man Kim,et al.  Priority-Based Hierarchical Operational Management for Multiagent-Based Microgrids , 2014 .

[115]  Yves Demazeau,et al.  From Analysis to Deployment: A Multi-agent Platform Survey , 2000, ESAW.

[116]  Agostino Poggi,et al.  Jade - a fipa-compliant agent framework , 1999 .

[117]  Zhang Jianhua,et al.  A Review on Microgrid Technology Containing Distributed Generation System , 2009 .

[118]  Wu Jie,et al.  A multi-agent solution to energy management in hybrid renewable energy generation system , 2011 .

[119]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .