Best-response dynamics out of sync: complexity and characterization

In many computational and economic models of multi-agent interaction, each participant repeatedly "best-responds" to the others' actions. Game theory research on the prominent "best-response dynamics" model typically relies on the premise that the interaction between agents is somehow synchronized. However, in many real-life settings, e.g., internet protocols and large-scale markets, the interaction between participants is asynchronous. We tackle the following important questions: (1) When are best-response dynamics guaranteed to converge to an equilibrium even under asynchrony? (2) What is the (computational and communication) complexity of verifying guaranteed convergence? We show that, in general, verifying guaranteed convergence is intractable. In fact, our main negative result establishes that this task is undecidable. We exhibit, in contrast, positive results for several environments of interest, including complete, computationally-tractable, characterizations of convergent systems. We discuss the algorithmic implications of our results, which extend beyond best-response dynamics to applications such as asynchronous Boolean circuits.

[1]  Steven M. Nowick,et al.  An introduction to asynchronous circuit design , 1998 .

[2]  Noga Alon,et al.  The space complexity of approximating the frequency moments , 1996, STOC '96.

[3]  S. Hart Adaptive Heuristics , 2005 .

[4]  Noga Alon,et al.  The Space Complexity of Approximating the Frequency Moments , 1999 .

[5]  Vahab S. Mirrokni,et al.  On the complexity of nash dynamics and sink equilibria , 2009, EC '09.

[6]  Michael Schapira,et al.  Searching for Stability in Interdomain Routing , 2009, IEEE INFOCOM 2009.

[7]  Faith Ellen,et al.  Hundreds of impossibility results for distributed computing , 2003, Distributed Computing.

[8]  Yishay Mansour,et al.  How long to equilibrium? The communication complexity of uncoupled equilibrium procedures , 2010, Games Econ. Behav..

[9]  No regret with delayed information ∗ , 2012 .

[10]  Shlomi Dolev,et al.  Self Stabilization , 2004, J. Aerosp. Comput. Inf. Commun..

[11]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[12]  Noam Nisan,et al.  The Communication Complexity of Approximate Set Packing and Covering , 2002, ICALP.

[13]  Martin Suchara,et al.  BGP safety with spurious updates , 2011, 2011 Proceedings IEEE INFOCOM.

[14]  Alex Fabrikant,et al.  On the Structure of Weakly Acyclic Games , 2010, Theory of Computing Systems.

[15]  Nancy A. Lynch,et al.  A hundred impossibility proofs for distributed computing , 1989, PODC '89.

[16]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[17]  Noam Nisan,et al.  Asynchronous Best-Reply Dynamics , 2008, WINE.

[18]  Jennifer Rexford,et al.  Stable internet routing without global coordination , 2001, TNET.

[19]  Rebecca N. Wright,et al.  Distributed computing with rules of thumb , 2011, PODC '11.

[20]  Rebecca N. Wright,et al.  Distributed Computing with Adaptive Heuristics , 2009, ICS.

[21]  H. Young,et al.  The Evolution of Conventions , 1993 .

[22]  L. Shapley,et al.  Potential Games , 1994 .

[23]  Alex Fabrikant,et al.  On the Structure of Weakly Acyclic Games , 2010, SAGT.

[24]  James Aspnes,et al.  An Introduction to Population Protocols , 2007, Bull. EATCS.

[25]  Gordon T. Wilfong,et al.  The stable paths problem and interdomain routing , 2002, TNET.

[26]  Michael Schapira,et al.  Interdomain routing and games , 2008, SIAM J. Comput..

[27]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[28]  Brighten Godfrey,et al.  Incentive compatibility and dynamics of congestion control , 2010, SIGMETRICS '10.

[29]  Christos H. Papadimitriou,et al.  The complexity of game dynamics: BGP oscillations, sink equilibria, and beyond , 2008, SODA '08.