A game theoretical formulation for distributed optimization problems

The focus of this paper is to develop a theoretical framework for analysis and design of distributed optimization problem in multi-agent systems by using the language of game theory and cooperative control methodology. In the framework, a piecewise-constant and binary-valued matrix in the cooperative control theory is introduced to describe the sensing/communication among agents and to cope with the practical situations where the information sharing may be in a distributed, dynamically changing and local manner. Based on information acquisition/communication model, state based ordinal potential game is designed to capture the optimal solution to distributed optimization problems in multi-agent systems by appropriately specifying local objective function for each individual decision maker. It is worth noting that the proposed analysis and design methodology has the advantages that the resulted equilibriums are capable of solving the distributed optimization problems even if the corresponding communication topologies is local, time-varying and intermittent. Meanwhile, the minimal requirement for the communication among the agents is provided to ensure the global objective is desirable under the new framework.

[1]  Jason R. Marden,et al.  Joint Strategy Fictitious Play with Inertia for Potential Games , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[2]  H. Peyton Young,et al.  Learning by trial and error , 2009, Games Econ. Behav..

[3]  Zhihua Qu,et al.  Cooperative Control of Dynamical Systems With Application to Autonomous Vehicles , 2008, IEEE Transactions on Automatic Control.

[4]  Z. Qu,et al.  Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles , 2009 .

[5]  Jason R. Marden,et al.  Designing games to handle coupled constraints , 2010, 49th IEEE Conference on Decision and Control (CDC).

[6]  Wei Lin,et al.  A design of distributed nonzero-sum Nash strategies , 2010, 49th IEEE Conference on Decision and Control (CDC).

[7]  H. Peyton Young,et al.  Learning efficient Nash equilibria in distributed systems , 2012, Games Econ. Behav..

[8]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[9]  Adam Wierman,et al.  Distributed welfare games with applications to sensor coverage , 2008, 2008 47th IEEE Conference on Decision and Control.

[10]  Jason R. Marden,et al.  Designing Games for Distributed Optimization , 2013, IEEE J. Sel. Top. Signal Process..

[11]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[12]  L. Shapley,et al.  Potential Games , 1994 .

[13]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[15]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[16]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[17]  Jason R. Marden,et al.  Decoupling Coupled Constraints Through Utility Design , 2014, IEEE Transactions on Automatic Control.