From rationality to cooperativeness: The totally mixed Nash equilibrium in Markov strategies in the iterated Prisoner’s Dilemma

In this research, the social behavior of the participants in a Prisoner's Dilemma laboratory game is explained on the basis of the quantal response equilibrium concept and the representation of the game in Markov strategies. In previous research, we demonstrated that social interaction during the experiment has a positive influence on cooperation, trust, and gratefulness. This research shows that the quantal response equilibrium concept agrees only with the results of experiments on cooperation in Prisoner’s Dilemma prior to social interaction. However, quantal response equilibrium does not explain of participants’ behavior after social interaction. As an alternative theoretical approach, an examination was conducted of iterated Prisoner's Dilemma game in Markov strategies. We built a totally mixed Nash equilibrium in this game; the equilibrium agrees with the results of the experiments both before and after social interaction.

[1]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[2]  Alvin E. Roth,et al.  Individual Rationality and Nash's Solution to the Bargaining Problem , 1977, Math. Oper. Res..

[3]  R. Selten,et al.  End behavior in sequences of finite prisoner's dilemma supergames , 1986 .

[4]  E. Damme.  Refinements of the Nash Equilibrium Concept , 1983 .

[5]  Richard Wheeler,et al.  Decentralized learning in finite Markov chains , 1985, 1985 24th IEEE Conference on Decision and Control.

[6]  Richmond Campbell,et al.  Paradoxes of Rationality and Cooperation: Prisoner's Dilemma and Newcomb's Problem , 1986 .

[7]  George Tauchen,et al.  Finite state markov-chain approximations to univariate and vector autoregressions , 1986 .

[8]  M. Whinston,et al.  Coalition-Proof Nash Equilibria I. Concepts , 1987 .

[9]  R. Boyd,et al.  No pure strategy is evolutionarily stable in the repeated Prisoner's Dilemma game , 1987, Nature.

[10]  I. MacMillan,et al.  Resource Cooptation Via Social Contracting: Resource Acquisition Strategies for New Ventures , 1990 .

[11]  R. Roberts,et al.  Determinants of corporate social responsibility disclosure: An application of stakeholder theory , 1992 .

[12]  R. Rob,et al.  Learning, Mutation, and Long Run Equilibria in Games , 1993 .

[13]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[14]  R. McKelvey,et al.  Quantal Response Equilibria for Normal Form Games , 1995 .

[15]  C. Hauert,et al.  Effects of increasing the number of players and memory size in the iterated Prisoner's Dilemma: a numerical approach , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[16]  R. McKelvey,et al.  Quantal Response Equilibria for Extensive Form Games , 1998 .

[17]  M. Milinski,et al.  Working memory constrains human cooperation in the Prisoner's Dilemma. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Debraj Ray,et al.  Evolving Aspirations and Cooperation , 1998 .

[19]  Roberto A. Weber,et al.  The effects of payoff magnitude and heterogeneity on behavior in 2 x 2 games with unique mixed strategy equilibria , 2000 .

[20]  Jacob K. Goeree,et al.  Asymmetric inequality aversion and noisy behavior in alternating-offer bargaining games , 2000 .

[21]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[22]  Jacob K. Goeree,et al.  Quantal Response Equilibrium and Overbidding in Private-Value Auctions , 2002, J. Econ. Theory.

[23]  S. Bornholdt,et al.  Coevolutionary games on networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  A. Colman.  Cooperation, psychological game theory, and limitations of rationality in social interaction , 2003, Behavioral and Brain Sciences.

[25]  E. Ostrom,et al.  Trust and reciprocity : interdisciplinary lessons from experimental research , 2003 .

[26]  M. Delgado,et al.  Perceptions of moral character modulate the neural systems of reward during the trust game , 2005, Nature Neuroscience.

[27]  Charles A. Holt,et al.  Regular Quantal Response Equilibrium , 2005 .

[28]  C. Hauert,et al.  Models of cooperation based on the Prisoner's Dilemma and the Snowdrift game , 2005 .

[29]  Abagail McWilliams,et al.  Corporate Social Responsibility: Strategic Implications , 2006 .

[30]  C. Hauert,et al.  Synergy and discounting of cooperation in social dilemmas. , 2006, Journal of theoretical biology.

[31]  U. Fischbacher.  z-Tree: Zurich toolbox for ready-made economic experiments , 1999 .

[32]  Syngjoo Choi,et al.  Social learning in networks: a Quantal Response Equilibrium analysis of experimental data , 2012 .

[33]  James H. Fowler,et al.  Heritability of cooperative behavior in the trust game , 2008, Proceedings of the National Academy of Sciences.

[34]  Florian Englmaier,et al.  Optimal Incentive Contracts Under Inequity Aversion , 2005, Games Econ. Behav..

[35]  Juan Wang,et al.  HETEROGENEOUS LINK WEIGHT PROMOTES THE COOPERATION IN SPATIAL PRISONER'S DILEMMA , 2011 .

[36]  W. Press,et al.  Iterated Prisoner’s Dilemma contains strategies that dominate any evolutionary opponent , 2012, Proceedings of the National Academy of Sciences.

[37]  Junqing Sun,et al.  Spatial prisoner’s dilemma games with increasing size of the interaction neighborhood on regular lattices , 2012 .

[38]  Norovsambuu Tumennasan,et al.  Err is Human : Implementation in Quantal Response Equilibria , 2011 .

[39]  Boyu Zhang.  Social Learning in the Ultimatum Game , 2013, PloS one.

[40]  Zengru Di,et al.  Stability of Mixed-Strategy-Based Iterative Logit Quantal Response Dynamics in Game Theory , 2013, PloS one.

[41]  Yi Tao,et al.  Evolution of Conformity in Social Dilemmas , 2015, PloS one.

[42]  Zhen Wang,et al.  Heterogeneous Coupling between Interdependent Lattices Promotes the Cooperation in the Prisoner’s Dilemma Game , 2015, PloS one.

[43]  Elliot T. Berkman,et al.  Sociality as a Natural Mechanism of Public Goods Provision , 2015, PloS one.

[44]  Zhongke Gao,et al.  Spatial prisoner's dilemma games with increasing neighborhood size and individual diversity on two interdependent lattices , 2015 .

[45]  M. Myagkov,et al.  Impact of Short Social Training on Prosocial Behaviors: An fMRI Study , 2016, Frontiers in Systems Neuroscience.

[46]  Elliot T. Berkman,et al.  Choice of the Group Increases Intra-Cooperation , 2016, EEML@CLA.

[47]  E. Akin.  Good strategies for the iterated prisoner's dilemma: Smale vs. Markov , 2016, 1610.05262.

[48]  A. Peshkovskaya,et al.  The socialization effect on decision making in the Prisoner's Dilemma game: An eye-tracking study , 2017, PloS one.