Discovering effective strategies for the iterated prisoner's dilemma using genetic algorithms

The iterated prisoner's dilemma is used to illustrate and model the phenomena in economics, sociology, psychology, as well as in the biological sciences such as evolutionary biology. The discovery and optimization of IPD strategies in real-world applications requires flexible strategy representation. The comparison of deterministic and non-deterministic finite state machines as the representations of strategies for the iterated prisoner's dilemma is presented. A novel chromosome representation scheme for non-deterministic Mealy finite state machines is proposed. The research on efficiency of the strategies evolved using genetic algorithms was made. Best results in competition with unknown strategies were obtained by non-deterministic strategies.

[1]  H. Moraal.  Finding best counterstrategies for generalized Iterated Prisoner's Dilemma games , 2000 .

[2]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[3]  John H. Miller,et al.  Rational Cooperation in the Finitely Repeated Prisoner's Dilemma: Experimental Evidence , 1993 .

[4]  Colm O'Riordan.  A forgiving strategy for the Iterated Prisoner's Dilemma , 2000, J. Artif. Soc. Soc. Simul..

[5]  Philippe Mathieu,et al.  Our Meeting with Gradual, A Good Strategy for the Iterated Prisoner's Dilemma , 1996 .

[6]  J. Sayer Minas,et al.  The Behavior of Prisoners in a “Prisoner's Dilemma” Game , 1960 .

[7]  Xin Yao,et al.  Co-Evolution in Iterated Prisoner's Dilemma with Intermediate Levels of Cooperation: Application to Missile Defense , 2002, Int. J. Comput. Intell. Appl..

[8]  Xin Yao,et al.  Why more choices cause less cooperation in iterated prisoner's dilemma , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[9]  Bruce G. Linster.  Evolutionary Stability in the Infinitely Repeated Prisoners' Dilemma Played by Two-State Moore Machines , 1992 .

[10]  Jean-Paul Delahaye,et al.  Complete Classes of Strategies for the Classical Iterated Prisoner's Dilemma , 1998, Evolutionary Programming.

[11]  Robert Hoffmann,et al.  The Simulation of Localised Interaction and Learning in Artificial Adaptive Agents , 1996, Evolutionary Computing, AISB Workshop.

[12]  X. Yao,et al.  How important is your reputation in a multi-agent environment , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).