Robustness of Learning in Games With Heterogeneous Players

We consider stochastic learning dynamics in games and present a novel notion of robustness to heterogeneous players for a stochastically stable action profile. A standard assumption in these dynamics is that all the players are homogeneous, and their decision strategies can be modeled as perturbed versions of myopic best or better response strategies. We relax this assumption and propose a robustness criteria, which characterizes a stochastically stable action profile as robust to heterogeneous behaviors if a small fraction of heterogeneous players cannot alter the long-run behavior of the rest of the population. In particular, we consider confused players who randomly update their actions, stubborn players who never update their actions, and strategic players who attempt to manipulate the population behavior. We establish that radius-coradius based analysis can provide valuable insights into the robustness properties of stochastic learning dynamics for various game settings. We derive sufficient conditions for a stochastically stable profile to be robust to a confused, stubborn, or strategic player and elaborate these conditions through carefully designed examples. Then we explore the role of network structure in our proposed notion of robustness by considering graphical coordination games and identifying network topologies in which a single heterogeneous player is sufficient to alter the population’s behavior. Our results will provide foundations for future research on designing networked systems that are robust to players with heterogeneous decision strategies.

[1]  Philip N. Brown,et al.  The Impact of Complex and Informed Adversarial Behavior in Graphical Coordination Games , 2019, IEEE Transactions on Control of Network Systems.

[2]  Jeff S. Shamma,et al.  Path to Stochastic Stability: Comparative Analysis of Stochastic Learning Dynamics in Games , 2018, ArXiv.

[3]  Jonathan Newton Conventions under Heterogeneous Behavioural Rules , 2020 .

[4]  Heinrich H. Nax,et al.  Deep and Shallow Thinking in the Long Run , 2020, SSRN Electronic Journal.

[5]  Jeff S. Shamma,et al.  Game theory, learning, and control systems , 2019, National science review.

[6]  Jonathan Newton,et al.  Agency, Potential and Contagion , 2017, Games Econ. Behav..

[7]  Waseem Abbas,et al.  Robustness Of Stochastic Learning Dynamics To Player Heterogeneity In Games , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[8]  Philip N. Brown,et al.  Security Against Impersonation Attacks in Distributed Systems , 2017, IEEE Transactions on Control of Network Systems.

[9]  Philip N. Brown,et al.  The Impact of Informed Adversarial Behavior in Graphical Coordination Games , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[10]  Jonathan Newton,et al.  Evolutionary Game Theory: A Renaissance , 2018, Games.

[11]  Jean-Paul Carvalho Coordination and culture , 2016, Economic Theory.

[12]  Jonathan Newton,et al.  Heterogeneity in preferences and behavior in threshold models , 2017 .

[13]  Panayotis Mertikopoulos,et al.  On the robustness of learning in games with stochastically perturbed payoff observations , 2014, Games Econ. Behav..

[14]  E. Young Contagion , 2015, New Scientist.

[15]  Jason R. Marden,et al.  Game Theory and Distributed Control , 2015 .

[16]  H. Peyton Young,et al.  Rapid innovation diffusion in social networks , 2014, Proceedings of the National Academy of Sciences.

[17]  Nick Netzer,et al.  Robust stochastic stability , 2014 .

[18]  Jeff S. Shamma,et al.  Robustness of stochastic stability in game theoretic learning , 2013, 2013 American Control Conference.

[19]  Adam Wierman,et al.  Distributed Welfare Games , 2013, Oper. Res..

[20]  H. Peyton Young,et al.  The dynamics of social innovation , 2011, Proceedings of the National Academy of Sciences.

[21]  William H. Sandholm,et al.  Population Games And Evolutionary Dynamics , 2010, Economic learning and social evolution.

[22]  Andrea Montanari,et al.  The spread of innovations in social networks , 2010, Proceedings of the National Academy of Sciences.

[23]  Nick Netzer,et al.  The logit-response dynamics , 2010, Games Econ. Behav..

[24]  Marcin Peski,et al.  Generalized risk-dominance and asymmetric dynamics , 2010, J. Econ. Theory.

[25]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[27]  Glenn Ellison Basins of Attraction, Long-Run Stochastic Stability, and the Speed of Step-by-Step Evolution , 2000 .

[28]  Jörgen W. Weibull,et al.  Clever Agents in Young's Evolutionary Bargaining Model , 1999 .

[29]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[30]  Glenn Ellison,et al.  Learning from Personal Experience: One Rational Guy and the Justification of Myopia , 1997 .

[31]  F. Vega-Redondo,et al.  Efficient Equilibrium Selection in Evolutionary Games with Random Matching , 1996 .

[32]  Michihiro Kandori,et al.  Evolution of Equilibria in the Long Run: A General Theory and Applications , 1995 .

[33]  L. Blume The Statistical Mechanics of Strategic Interaction , 1993 .

[34]  David M. Kreps,et al.  Learning Mixed Equilibria , 1993 .

[35]  H. Young An Evolutionary Model of Bargaining , 1993 .

[36]  H. Young,et al.  The Evolution of Conventions , 1993 .

[37]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .