Payoff Control in Repeated Games

Evolutionary game theory is a powerful mathematical framework to study how intelligent individuals adjust their strategies in collective interactions. It has been widely believed that it is impossible to unilaterally control players' payoffs in games, since payoffs are jointly determined by all players. Until recently, a class of so-called zero-determinant strategies are revealed, which enables a player to make a unilateral payoff control over her partners in two-action repeated games with a constant continuation probability. The existing methods, however, lead to the curse of dimensionality when the complexity of games increases. In this paper, we propose a new mathematical framework to study ruling strategies (with which a player unilaterally makes a linear relation rule on players' payoffs) in repeated games with an arbitrary number of actions or players, and arbitrary continuation probability. We establish an existence theorem of ruling strategies and develop an algorithm to find them. In particular, we prove that strict Markov ruling strategy exists only if either the repeated game proceeds for an infinite number of rounds, or every round is repeated with the same probability. The proposed mathematical framework also enables the search of collaborative ruling strategies for an alliance to control outsiders. Our method provides novel theoretical insights into payoff control in complex repeated games, which overcomes the curse of dimensionality.

[1]  Torsten Röhl,et al.  Extortion subdues human players but is finally punished in the prisoner’s dilemma , 2014, Nature Communications.

[2]  Alexander J. Stewart,et al.  Extortion and cooperation in the Prisoner’s Dilemma , 2012, Proceedings of the National Academy of Sciences.

[3]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[4]  J. Koenderink Q… , 2014, Les noms officiels des communes de Wallonie, de Bruxelles-Capitale et de la communaute germanophone.

[5]  C. Hauert,et al.  Effects of increasing the number of players and memory size in the iterated Prisoner's Dilemma: a numerical approach , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[6]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[7]  Martin A. Nowak,et al.  Evolutionary performance of zero-determinant strategies in multiplayer games , 2015, Journal of theoretical biology.

[8]  W. Press,et al.  Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent , 2012, Proceedings of the National Academy of Sciences.

[9]  Alexander J. Stewart,et al.  From extortion to generosity, evolution in the Iterated Prisoner’s Dilemma , 2013, Proceedings of the National Academy of Sciences.

[10]  Arne Traulsen,et al.  Partners or rivals? Strategies for the iterated prisoner's dilemma☆ , 2015, Games Econ. Behav..

[11]  M. Dufwenberg Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[12]  Ethan Akin,et al.  The Iterated Prisoner's Dilemma: Good Strategies and Their Dynamics , 2012, 1211.0969.

[13]  Dong Hao,et al.  Zero-Determinant Strategies in Iterated Public Goods Game , 2014, Scientific Reports.

[14]  Long Wang,et al.  Evolution of cooperation on temporal networks , 2016, Nature Communications.

[15]  Martin A Nowak,et al.  Evolution of extortion in Iterated Prisoner’s Dilemma games , 2012, Proceedings of the National Academy of Sciences.

[16]  J. M. Smith The theory of games and the evolution of animal conflicts. , 1974, Journal of theoretical biology.

[17]  Long Wang,et al.  Evolution of Cooperation on Stochastic Dynamical Networks , 2010, PloS one.

[18]  Martin A. Nowak,et al.  Evolutionary dynamics with game transitions , 2019, Proceedings of the National Academy of Sciences.

[19]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[20]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[21]  Aming Li,et al.  Spatial reciprocity in the evolution of cooperation , 2019, Proceedings of the Royal Society B.

[22]  Arne Traulsen,et al.  Cooperation and control in multiplayer social dilemmas , 2014, Proceedings of the National Academy of Sciences.

[23]  Alex McAvoy,et al.  Autocratic strategies for iterated games with arbitrary action spaces , 2015, Proceedings of the National Academy of Sciences.

[24]  Arne Traulsen,et al.  Evolving synergetic interactions , 2015, bioRxiv.