Multi-agent reinforcement learning for microgrids

This paper presents a general framework for Microgrids control based on Multi Agent System Technology. The proposed architecture is capable to integrate several functionalities, adaptable to the complexity and the size of the Microgrid. To achieve this, the idea of layered learning is used, where the various controls and actions of the agents are grouped depending on their effect on the environment. Moreover this paper, focus on how the agent will cooperate in order to achieve their goals. The core of the cooperation is a Multi Agent Reinforcement Learning Algorithm that allows the system to operate autonomously in island mode.

[1]  Jeffrey S. Rosenschein,et al.  Negotiation and Task Sharing Among Autonomous Agents in Cooperative Domains , 1989, IJCAI.

[2]  T. Nagata,et al.  A multi-agent approach to power system restoration , 2002 .

[3]  A.L. Dimeas,et al.  Operation of a multiagent system for microgrid control , 2005, IEEE Transactions on Power Systems.

[4]  Tuomas Sandholm,et al.  On Multiagent Q-Learning in a Semi-Competitive Domain , 1995, Adaption and Learning in Multi-Agent Systems.

[5]  B. Howe,et al.  The future's smart delivery system [electric power supply] , 2004, IEEE Power and Energy Magazine.

[6]  Chris Watkins,et al.  Learning from delayed rewards , 1989 .

[7]  Manuela M. Veloso,et al.  Team-Partitioned, Opaque-Transition Reinforced Learning , 1998, RoboCup.

[8]  Li Gengyin,et al.  A multi-agent based dispatching operation instructing system in electric power systems , 2003, 2003 IEEE Power Engineering Society General Meeting (IEEE Cat. No.03CH37491).

[9]  S.D.J. McArthur,et al.  The design of a multi-agent transformer condition monitoring system , 2004, IEEE Transactions on Power Systems.

[10]  J. R. McDonald,et al.  A multiagent architecture for protection engineering diagnostic assistance , 2003 .

[11]  N. Hatziargyriou,et al.  Operation of a prototype microgrid system based on micro-sources quipped with fast-acting power electronics interfaces , 2004, 2004 IEEE 35th Annual Power Electronics Specialists Conference (IEEE Cat. No.04CH37551).

[12]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[13]  Hans Akkermans,et al.  Decentralized Markets versus Central Control: A Comparative Study , 1999, J. Artif. Intell. Res..

[14]  Jeffrey M. Bradshaw,et al.  Software agents , 1997 .

[15]  Jeffrey S. Rosenschein,et al.  Rules of Encounter - Designing Conventions for Automated Negotiation among Computers , 1994 .

[16]  Nikos D. Hatziargyriou,et al.  A Multi-agent System for Microgrids , 2004, SETN.