Evolving Behaviors in the Iterated Prisoner's Dilemma

Evolutionary programming experiments are conducted to investigate the conditions that promote the evolution of cooperative behavior in the iterated prisoner's dilemma. A population of logical stimulus-response devices is maintained over successive generations with selection based on individual fitness. The reward for selfish behavior is varied across a series of trials. Simulations indicate three distinct patterns of behaviors in which mutual cooperation is inevitable, improbable, or apparently random. The ultimate behavior can be reliably predicted by examining the payoff matrix that defines the reward for alternative joint behaviors.

[1]  D. Fogel.  The evolution of intelligent decision making in gaming , 1991 .

[2]  George H. Burgin,et al.  COMPETITIVE GOAL-SEEKING THROUGH EVOLUTIONARY?PROGRAMMING. , 1969 .

[3]  George H. Mealy,et al.  A method for synthesizing sequential circuits , 1955 .

[4]  J. Sayer Minas,et al.  Some descriptive aspects of two-person non-zero-sum games , 1959 .

[5]  Stuart H. Rubin,et al.  Case-based learning: A new paradigm for automated knowledge acquisition , 1992 .

[6]  R. K. Lindsay.  Artificial Evolution of Intelligence. , 1968 .

[7]  George H. Burgin,et al.  Systems Identification by Quasilinearization and by Evolutionary Programming , 1973 .

[8]  D. B. Fogel,et al.  Using evolutionary programing to create neural networks that are capable of playing tic-tac-toe , 1993, IEEE International Conference on Neural Networks.

[9]  J. W. Atmar,et al.  Speculation on the evolution of intelligence and its possible realization in machine form. , 1976 .

[10]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[11]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[12]  J. R. McDonnell,et al.  MOBILE ROBOT PATH PLANNING USING EVOLUTIONARY PROGRAMMING , 1990, 1990 Conference Record Twenty-Fourth Asilomar Conference on Signals, Systems and Computers, 1990..

[13]  G. H. Burgin,et al.  On Playing Two-Person Zero-Sum Games against Nonminimax Players , 1969, IEEE Trans. Syst. Sci. Cybern..

[14]  A. Rapoport.  Optimal policies for the Prisoner's Dilemma. , 1967, Psychological review.

[15]  R. Boyd,et al.  No pure strategy is evolutionarily stable in the repeated Prisoner's Dilemma game , 1987, Nature.

[16]  As Fraser,et al.  Simulation of Genetic Systems by Automatic Digital Computers VII. Effects of Reproductive Ra'l'e, and Intensity of Selection, on Genetic Structure , 1960 .

[17]  Ralph C. Huntsinger,et al.  Engineering applications of finite automata , 1969 .

[18]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  E. Thorndike.  On the Organization of Intellect. , 1921 .

[21]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[22]  R. Axelrod.  Effective Choice in the Prisoner's Dilemma , 1980 .

[23]  D. Fogel.  Applying evolutionary programming to selected traveling salesman problems , 1993 .

[24]  R. J. Solomonoff,et al.  Some recent work in artificial intelligence , 1966 .

[25]  J. Reed,et al.  Simulation of biological evolution and machine learning. I. Selection of self-reproducing numeric patterns by data processing machines, effects of hereditary control, mutation type and crossing. , 1967, Journal of theoretical biology.

[26]  A. Church.  Edward F. Moore. Gedanken-experiments on sequential machines. Automata studies , edited by C. E. Shannon and J. McCarthy, Annals of Mathematics studies no. 34, litho-printed, Princeton University Press, Princeton1956, pp. 129–153. , 1958, Journal of Symbolic Logic.

[27]  D. Hofstadter.  Metamagical Themas: Questing for the Essence of Mind and Pattern , 1985 .

[28]  R. Axelrod.  More Effective Choice in the Prisoner's Dilemma , 1980 .

[29]  David B. Fogel,et al.  System Identification Through Simulated Evolution: A Machine Learning Approach to Modeling , 1991 .

[30]  Thomas Bäck,et al.  A Survey of Evolution Strategies , 1991, ICGA.