Effects of configuration of agents with different strategy representations on the evolution of cooperative behavior in a spatial IPD game

It is well-known in the literature that the choice of a strategy representation scheme has a large effect on the evolution of cooperative behavior in an IPD (Iterated Prisoner's Dilemma) game. Different representation schemes often lead to totally different results. The evolution of cooperative behavior is easy under some representation schemes while it is difficult under other schemes. An interesting research issue is to examine the evolution of cooperative behavior in an inhomogeneous population consisting of heterogeneous agents with different representation schemes. In our former study, we used an inhomogeneous population where one of two representation schemes was randomly assigned with the same probability to each cell in a two-dimensional grid-world. In this setting, every agent is likely to have both types of representation schemes in its neighborhood. That is, an IPD game is likely to be played not only between homogeneous agents with the same representation scheme but also between heterogeneous agents with different representation schemes everywhere in the grid-world. In this paper, we examine the effect of spatial configurations of two types of agents on the evolution of cooperative behavior in a spatial IPD game. In computational experiments, agents with one representation scheme are clustered in a specific region of a two-dimensional grid-world (e.g., 7×7 cells at the center of an 11×11 grid-world). Agents with the other representation scheme are placed in the remaining cells. In this setting, the interaction through the IPD game between heterogeneous agents is limited only around the boundary between the two types of agents in the grid-world. Experimental results are compared between this setting and the random assignment in our former study.

[1]  David Sloan Wilson,et al.  Structured Demes and Trait-Group Variation , 1979, The American Naturalist.

[2]  M Slatkin,et al.  Coevolution in structured demes. , 1979, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Hisao Ishibuchi,et al.  Evolution of Strategies With Different Representation Schemes in a Spatial Iterated Prisoner's Dilemma Game , 2011, IEEE Transactions on Computational Intelligence and AI in Games.

[4]  M A Nowak,et al.  The arithmetics of mutual help. , 1995, Scientific American.

[5]  Xin Yao,et al.  The Iterated Prisoners' Dilemma - 20 Years On , 2007, Advances in Natural Computation.

[6]  Alun L. Lloyd,et al.  Computing Bouts of the Prisoner's Dilemma , 1995 .

[7]  Daniel A. Ashlock,et al.  Fingerprint Analysis of the Noisy Prisoner's Dilemma Using a Finite-State Representation , 2007, IEEE Transactions on Computational Intelligence and AI in Games.

[8]  D. Wilson Structured Demes and the Evolution of Group-Advantageous Traits , 1977, The American Naturalist.

[9]  David B. Fogel,et al.  Evolving Behaviors in the Iterated Prisoner's Dilemma , 1993, Evolutionary Computation.

[10]  Hisao Ishibuchi,et al.  Evolution of iterated prisoner's dilemma game strategies in structured demes under random pairing in game playing , 2005, IEEE Transactions on Evolutionary Computation.

[11]  Daniel A. Ashlock,et al.  Fingerprinting: Visualization and Automatic Analysis of Prisoner's Dilemma Strategies , 2008, IEEE Transactions on Evolutionary Computation.

[12]  Eun-Youn Kim,et al.  Understanding representational sensitivity in the iterated prisoner's dilemma with fingerprints , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Brauchli,et al.  Evolution of cooperation in spatially structured populations , 1999, Journal of theoretical biology.

[14]  Brian Charlesworth,et al.  A Note on the Evolution of Altruism in Structured Demes , 1979, The American Naturalist.

[15]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .