Effects of Spatial Structures on Evolution of Iterated Prisoner’s Dilemma Game Strategies in Single-Dimensional and Two-Dimensional Grids

We examine the effect of spatial structures on the evolution of iterated prisoner's dilemma (IPD) game strategies through computational experiments in single-dimensional and two-dimensional grid-worlds. Our computational experiments have two characteristic features. One is the use of a random pairing scheme in the IPD game where each player plays against a different randomly chosen opponent at every round of the dilemma game. The random pairing scheme makes it very difficult for players to evolve cooperative behavior. The other characteristic feature is the use of two neighborhood structures, which follows the concept of structured demes. One is for the interaction among players through the IPD game. A player in each cell in a grid-world plays against its neighbors defined by this neighborhood structure. The other is for the mating of strategies by genetic operations. A new strategy for a player is generated by genetic operations from a pair of parent strings, which are selected from its neighbors defined by the second neighborhood structure. It is shown that cooperative behavior is evolved only when the interaction neighborhood is very small and the mating neighborhood is small.

[1]  Brian Charlesworth,et al.  A Note on the Evolution of Altruism in Structured Demes , 1979, The American Naturalist.

[2]  D. Helbing,et al.  The German Autobahn: an ITS test bed for examining dynamic traffic flow phenomena , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[3]  P. Grim Spatialization and greater generosity in the stochastic Prisoner's Dilemma. , 1996, Bio Systems.

[4]  L. Dugatkin,et al.  Cooperation among unrelated individuals: reciprocal altruism, by-product mutualism and group selection in fishes. , 1996, Bio Systems.

[5]  L. Dugatkin Cooperation Among Animals: An Evolutionary Perspective , 1997 .

[6]  L. Tesfatsion,et al.  Preferential partner selection in an evolutionary study of Prisoner's Dilemma. , 1994, Bio Systems.

[7]  David Sloan Wilson,et al.  Structured Demes and Trait-Group Variation , 1979, The American Naturalist.

[8]  Sung-Bae Cho,et al.  The Impact of Payoff Function and Local Interaction on the N-Player Iterated Prisoner's Dilemma , 2000, Knowledge and Information Systems.

[9]  Hisao Ishibuchi,et al.  Evolution of cooperative behavior in the iterated prisoner's dilemma under random pairing in game playing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[10]  F Vega-Redondo,et al.  Long-run cooperation in the one-shot Prisoner's Dilemma: a hierarchic evolutionary approach. , 1996, Bio Systems.

[11]  David B. Fogel,et al.  On the Relationship between the Duration of an Encounter and the Evolution of Cooperation in the Iterated Prisoner's Dilemma , 1995, Evolutionary Computation.

[12]  Robert H. Crites,et al.  Multiagent reinforcement learning in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[13]  P H Crowley,et al.  Evolving cooperation: strategies as hierarchies of rules. , 1996, Bio Systems.

[14]  Xin Yao,et al.  An Experimental Study of N-Person Iterated Prisoner's Dilemma Games , 1993, Informatica.

[15]  Margarita Ifti,et al.  Effects of neighbourhood size and connectivity on the spatial Continuous Prisoner's Dilemma. , 2004, Journal of theoretical biology.

[16]  Kristian Lindgren,et al.  Evolutionary phenomena in simple dynamics , 1992 .

[17]  M Slatkin,et al.  Coevolution in structured demes. , 1979, Proceedings of the National Academy of Sciences of the United States of America.

[18]  M A Nowak,et al.  The arithmetics of mutual help. , 1995, Scientific American.

[19]  L A Dugatkin,et al.  Evolving cooperation: the role of individual recognition. , 1996, Bio Systems.

[20]  Alun L. Lloyd,et al.  Computing Bouts of the Prisoner's Dilemma , 1995 .

[21]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[22]  M. Oliphant Evolving cooperation in the non-iterated prisoner''s dilemma , 1994 .

[23]  D. Wilson Structured Demes and the Evolution of Group-Advantageous Traits , 1977, The American Naturalist.

[24]  Brauchli,et al.  Evolution of cooperation in spatially structured populations , 1999, Journal of theoretical biology.

[25]  Xin Yao,et al.  Automatic modularization by speciation , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[26]  David B. Fogel,et al.  Evolving Behaviors in the Iterated Prisoner's Dilemma , 1993, Evolutionary Computation.

[27]  Hisao Ishibuchi,et al.  Evolution of iterated prisoner's dilemma game strategies in structured demes under random pairing in game playing , 2005, IEEE Transactions on Evolutionary Computation.