A game theoretic approach for the distributed control of multi-agent systems under directed and time-varying topology

This paper presents a new game theory based method to control multi-agent systems under directed and time varying interaction topology. First, the sensing/communication matrix is introduced to cope with information sharing among agents, and to provide the minimal information requirement which ensures the system level objective is desirable. Second, different from traditional methods of controlling multi-agent systems, non-cooperative games are investigated to enforce agents to make rational decisions. And a new game model, termed stochastic weakly acyclic game, is developed to capture the optimal solution to the distributed optimization problem for multi-agent systems with directed topology. It is worth noting that the system level objective can be achieved at the points of the corresponding equilibriums of the new game model. The proposed method is illustrated with an example in smart grid where multiple distributed generators are controlled to reach the fair power utilization profile in the game formulation to ensure the aggregated power output are optimal.

[1]  Lihua Xie,et al.  Network Topology and Communication Data Rate for Consensusability of Discrete-Time Multi-Agent Systems , 2011, IEEE Transactions on Automatic Control.

[2]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Convex Optimization Over Random Networks , 2011, IEEE Transactions on Automatic Control.

[3]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[4]  Jason R. Marden State based potential games , 2012, Autom..

[5]  Jason R. Marden,et al.  Payoff-Based Dynamics for Multiplayer Weakly Acyclic Games , 2009, SIAM J. Control. Optim..

[6]  Jason R. Marden,et al.  Joint Strategy Fictitious Play with Inertia for Potential Games , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[7]  Jason R. Marden,et al.  Designing games to handle coupled constraints , 2010, 49th IEEE Conference on Decision and Control (CDC).

[8]  H. Peyton Young,et al.  Learning by trial and error , 2009, Games Econ. Behav..

[9]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[10]  Zhihua Qu,et al.  Distributed estimation of algebraic connectivity of directed networks , 2013, Syst. Control. Lett..

[11]  Huijie Li,et al.  Virtual power plant-based distributed control strategy for multiple distributed generators , 2013 .

[12]  Zhihua Qu,et al.  A Self-Organizing Strategy for Power Flow Control of Photovoltaic Generators in a Distribution Network , 2011, IEEE Transactions on Power Systems.

[13]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[14]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[15]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Z. Qu,et al.  Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles , 2009 .

[17]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[18]  John N. Tsitsiklis,et al.  On Distributed Averaging Algorithms and Quantization Effects , 2008, IEEE Trans. Autom. Control..

[19]  Y. Jia,et al.  Formation control of discrete-time multi-agent systems by iterative learning approach , 2012 .

[20]  Adam Wierman,et al.  Overcoming the Limitations of Utility Design for Multiagent Systems , 2013, IEEE Transactions on Automatic Control.

[21]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[22]  H. Peyton Young,et al.  Strategic Learning and Its Limits , 2004 .

[23]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[24]  H. Ji,et al.  Leader-follower consensus for a class of nonlinear multi-agent systems , 2012 .