Fast convergence to nearly optimal solutions in potential games

We study the speed of convergence of decentralized dynamics to approximately optimal solutions in potential games. We consider α-Nash dynamics in which a player makes a move if the improvement in his payoff is more than an α factor of his own payoff. Despite the known polynomial convergence of α-Nash dynamics to approximate Nash equilibria in symmetric congestion games [7], it has been shown that the convergence time to approximate Nash equilibria in asymmetric congestion games is exponential [25]. In contrast to this negative result, and as the main result of this paper, we show that for asymmetric congestion games with linear and polynomial delay functions, the convergence time of α-Nash dynamics to an approximate optimal solution is polynomial in the number of players, with approximation ratio that is arbitrarily close to the price of anarchy of the game. In particular, we show this polynomial convergence under the minimal liveness assumption that each player gets at least one chance to move in every T steps. We also prove that the same polynomial convergence result does not hold for (exact) best-response dynamics, showing the α-Nash dynamics is required. We extend these results for congestion games to other potential games including weighted congestion games with linear delay functions, cut games (also called party affiliation games) and market sharing games.

[1]  Tim Roughgarden,et al.  The price of stability for network design with fair cost allocation , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[2]  Tim Roughgarden,et al.  How bad is selfish routing? , 2002, JACM.

[3]  Mihalis Yannakakis,et al.  Simple Local Search Problems That are Hard to Solve , 1991, SIAM J. Comput..

[4]  Tim Roughgarden,et al.  The Price of Stability for Network Design with Fair Cost Allocation , 2004, FOCS.

[5]  Vahab S. Mirrokni,et al.  Sink equilibria and convergence , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[6]  Paul G. Spirakis,et al.  Selfish Unsplittable Flows , 2004, ICALP.

[7]  Vahab S. Mirrokni,et al.  Convergence and approximation in potential games , 2006, Theor. Comput. Sci..

[8]  Joseph Naor,et al.  Non-Cooperative Multicast and Facility Location Games , 2007, IEEE J. Sel. Areas Commun..

[9]  Xiaotie Deng,et al.  Settling the Complexity of Two-Player Nash Equilibrium , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[10]  Berthold Vöcking,et al.  Tight bounds for worst-case equilibria , 2002, SODA '02.

[11]  Christos H. Papadimitriou,et al.  The complexity of pure Nash equilibria , 2004, STOC '04.

[12]  Marina Thottan,et al.  Market sharing games applied to content distribution in ad hoc networks , 2004, IEEE Journal on Selected Areas in Communications.

[13]  Adrian Vetta,et al.  Nash equilibria in competitive societies, with applications to facility location, traffic routing and auctions , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[14]  Paul W. Goldberg,et al.  The Complexity of Computing a Nash Equilibrium , 2009, SIAM J. Comput..

[15]  Vahab Mirrokni,et al.  Approximation algorithms for distributed and selfish agents , 2005 .

[16]  Mihalis Yannakakis,et al.  How easy is local search? , 1985, 26th Annual Symposium on Foundations of Computer Science (sfcs 1985).

[17]  Angelo Fanelli,et al.  On the Convergence of Multicast Games in Directed Networks , 2008, Algorithmica.

[18]  Berthold Vöcking,et al.  On the Impact of Combinatorial Structure on Congestion Games , 2006, FOCS.

[19]  Elias Koutsoupias,et al.  The price of anarchy of finite congestion games , 2005, STOC '05.

[20]  Berthold Vöcking,et al.  Inapproximability of pure nash equilibria , 2008, STOC.

[21]  Vahab S. Mirrokni,et al.  Convergence Issues in Competitive Games , 2004, APPROX-RANDOM.

[22]  Christos H. Papadimitriou,et al.  Algorithms, Games, and the Internet , 2001, ICALP.

[23]  Steve Chien,et al.  Convergence to approximate Nash equilibria in congestion games , 2007, SODA '07.

[24]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[25]  Yossi Azar,et al.  The Price of Routing Unsplittable Flow , 2005, STOC '05.

[26]  H PapadimitriouChristos,et al.  The complexity of computing a Nash equilibrium , 2009 .