Convergence to equilibrium of logit dynamics for strategic games

We present the first general bounds on the mixing time of logit dynamics for wide classes of strategic games. The logit dynamics describes the behaviour of a complex system whose individual components act "selfishly" and keep responding according to some partial ("noisy") knowledge of the system. In particular, we prove nearly tight bounds for potential games and games with dominant strategies. Our results show that, for potential games, the mixing time is upper and lower bounded by an "exponential" in the inverse of the noise and in the maximum potential difference. Instead, for games with dominant strategies, the mixing time cannot grow arbitrarily with the inverse of the noise. Finally, we refine our analysis for a subclass of potential games called "graphical" coordination games and we give evidence that the mixing time strongly depends on the structure of the underlying graph. Games in this class have been previously studied in Physics and, more recently, in Computer Science in the context of diffusion of new technologies.

[1]  H. Peyton Young Adaptive Learning in Systems of Interacting Agents , 2009, WINE.

[2]  Andrea Montanari,et al.  Convergence to Equilibrium in Local Interaction Games , 2009, FOCS.

[3]  Noam Nisan,et al.  Asynchronous Best-Reply Dynamics , 2008, WINE.

[4]  Giuseppe Persiano,et al.  Mixing Time and Stationary Expected Social Welfare of Logit Dynamics , 2010, SAGT.

[5]  John C. Harsanyi,et al.  Общая теория выбора равновесия в играх / A General Theory of Equilibrium Selection in Games , 1989 .

[6]  Amin Saberi,et al.  On the Inefficiency Ratio of Stable Equilibria in Congestion Games , 2009, WINE.

[7]  Mu-Fa Chen,et al.  Trilogy of Couplings and General Formulas for Lower Bound of Spectral Gap , 1998 .

[8]  H. Peyton Young,et al.  The Diffusion of Innovations in Social Networks , 2000 .

[9]  Martin Hoefer,et al.  Concurrent imitation dynamics in congestion games , 2009, PODC.

[10]  Jason R. Marden,et al.  Payoff-Based Dynamics for Multiplayer Weakly Acyclic Games , 2009, SIAM J. Control. Optim..

[11]  L. Blume The Statistical Mechanics of Strategic Interaction , 1993 .

[12]  F. Martinelli Lectures on Glauber dynamics for discrete spin models , 1999 .

[13]  Aris L. Moustakas,et al.  The emergence of rational behavior in the presence of stochastic perturbations , 2009, 0906.2094.

[14]  Elizabeth L. Wilmer,et al.  Markov Chains and Mixing Times , 2008 .

[15]  Paul G. Spirakis,et al.  Atomic Congestion Games: Fast, Myopic and Concurrent , 2008, SAGT.

[16]  Paolo Penna,et al.  Logit Dynamics with Concurrent Updates for Local Interaction Games , 2012, ESA.

[17]  Martin Hoefer,et al.  Dynamics in network interaction games , 2009, Distributed Computing.

[18]  Elchanan Mossel,et al.  Glauber dynamics on trees and hyperbolic graphs , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[19]  Martin E. Dyer,et al.  Path coupling: A technique for proving rapid mixing in Markov chains , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[20]  Glenn Ellison Learning, Local Interaction, and Coordination , 1993 .

[21]  Mark Jerrum,et al.  Approximating the Permanent , 1989, SIAM J. Comput..