Overcoming limitations of game-theoretic distributed control

Recently, game theory has been proposed as a tool for cooperative control. Specifically, the interactions of a multi-agent distributed system are modeled as a non-cooperative game where agents are self-interested. In this work, we prove that this approach of non-cooperative control has limitations with respect to engineering multi-agent systems. In particular, we prove that it is not possible to design budget balanced agent utilities that also guarantee that the optimal control is a Nash equilibrium. However, it is important to realize that game-theoretic designs are not restricted to the framework of non-cooperative games. In particular, we demonstrate that these limitations can be overcome by conditioning each player's utility on additional information, i.e., a state. This utility design fits into the framework of a particular form of stochastic games termed state-based games and is applicable in many application domains.

[1]  Jason R. Marden,et al.  The Price of Selfishness in Network Coding , 2009, IEEE Transactions on Information Theory.

[2]  Alfredo García,et al.  A Game-Theoretic Approach to Efficient Power Management in Sensor Networks , 2008, Oper. Res..

[3]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[4]  V. Georgiev Using Game Theory to Analyze Wireless Ad Hoc Networks . ” , 2008 .

[5]  Konstantina Papagiannaki,et al.  Interference Mitigation Through Power Control in High Density 802.11 WLANs , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[6]  L. Blume,et al.  POPULATION GAMES , 1995 .

[7]  H. Peyton Young,et al.  Strategic Learning and Its Limits , 2004 .

[8]  Sachin Katti,et al.  The Importance of Being Opportunistic: Practical Network Coding for Wireless Environments , 2005 .

[9]  Connections between cooperative control and potential games illustrated on the consensus problem , 2007, 2007 European Control Conference (ECC).

[10]  Tim Roughgarden,et al.  Designing networks with good equilibria , 2008, SODA '08.

[11]  Jason R. Marden,et al.  Joint Strategy Fictitious Play with Inertia for Potential Games , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[12]  H. Young Individual Strategy and Social Structure , 2020 .

[13]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[14]  W. Arthur,et al.  The Economy as an Evolving Complex System II , 1988 .

[15]  L. S. Shapley,et al.  17. A Value for n-Person Games , 1953 .

[16]  John N. Tsitsiklis,et al.  Decentralized detection by a large number of sensors , 1988, Math. Control. Signals Syst..

[17]  L. Shapley,et al.  Stochastic Games* , 1953, Proceedings of the National Academy of Sciences.

[18]  A.B. MacKenzie,et al.  Distributed topology control in ad-hoc networks: a game theoretic perspective , 2006, CCNC 2006. 2006 3rd IEEE Consumer Communications and Networking Conference, 2006..

[19]  Adam Wierman,et al.  Distributed welfare games with applications to sensor coverage , 2008, 2008 47th IEEE Conference on Decision and Control.

[20]  L. Shapley,et al.  Potential Games , 1994 .

[21]  Andreas Krause,et al.  Near-optimal Observation Selection using Submodular Functions , 2007, AAAI.

[22]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[23]  S. Hart,et al.  Potential, value, and consistency , 1989 .

[24]  Adrian Vetta,et al.  Nash equilibria in competitive societies, with applications to facility location, traffic routing and auctions , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[25]  L. Blume The Statistical Mechanics of Strategic Interaction , 1993 .

[26]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Christos G. Cassandras,et al.  Sensor Networks and Cooperative Control , 2005, CDC 2005.

[28]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[29]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .

[30]  Guillaume Haeringer,et al.  A new weight scheme for the Shapley value , 2006, Mathematical Social Sciences.