The Prisoner ’ s Dilemma Computer Tournaments Revisited

under the title, " Breeding hybrid strategies: the Prisoner's Dilemma computer tournaments revisited. " Page 2 ABSTRACT: The repeated Prisoner's Dilemma has proved to be a rich area of study for examining the tension between competition and coöperation. Computer tournaments—such as Axelrod's and Fader and Hauser's—have sought to obtain " effective " strategies in repeated games from diverse entrants, as a way of generating robust results from a broad range of competing strategies. The development of Holland's Genetic Algorithm has enabled researchers to dispense with open tournaments to obtain such diversity, and to derive strategies almost certainly closer to globally optimal, given the environment of rivals. This paper generalises a process reported by Axelrod in describing how the genetic algorithm has been used to generate winning strategies of specified complexity in a repeated 2-person Prisoner's Dilemma, against two specific " niches " of competing strategies, from Axelrod's second computer tournament. It also derives winning strategies in " noisy " PD, in which competitors are not certain of their opponents' moves. These strategies exhibit some of the characteristics seen in Rapoport's famous Tit for Tat. In an analysis of strategic complexity and its relationship to strategic success, the paper examines finite automata in an attempt to simplify the strategies obtained, which are conditioned on 1-, 2-, and 3-round memory of the moves and outcomes of previous rounds. Winning strategies are represented as finite automata.

[1]  Michael X Cohen,et al.  Coping with Complexity: The Adaptive Value of Changing Utility , 1984 .

[2]  George R. Feiwel,et al.  Issues in contemporary microeconomics and welfare , 1985 .

[3]  Carl A. Futia The complexity of economic decision rules , 1977 .

[4]  Patrick Suppes,et al.  Institute for Mathematical Studies in the Social Sciences , 1969 .

[5]  J. Holland,et al.  Artificial Adaptive Agents in Economic Theory , 1991 .

[6]  S. Vajda,et al.  GAMES AND DECISIONS; INTRODUCTION AND CRITICAL SURVEY. , 1958 .

[7]  R. Axelrod,et al.  The Further Evolution of Cooperation , 1988, Science.

[8]  D. Hofstadter Metamagical Themas: Questing for the Essence of Mind and Pattern , 1985 .

[9]  A. Neyman Bounded complexity justifies cooperation in the finitely repeated prisoners' dilemma , 1985 .

[10]  Gavin J. Wright An evolutionary theory of economic change , 1982 .

[11]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[13]  John R. Beaumont,et al.  Coping with Complexity: Perspectives for Economics, Management and Social Sciences , 2011 .

[14]  H. Gottinger Choice and complexity , 1987 .

[15]  Andrew Abarbanel Adaptive control of ill‐defined systems , 1986 .

[16]  A. Rubinstein Finite automata play the repeated prisoner's dilemma , 1986 .

[17]  Werner Hildenbrand,et al.  Contributions to mathematical economics in honor of Gérard Debreu , 1986 .

[18]  Robert E. Marks,et al.  Breeding hybrid strategies: optimal behaviour for oligopolists , 1989, ICGA.

[19]  Edward F. Moore,et al.  Gedanken-Experiments on Sequential Machines , 1956 .

[20]  R. Brady Optimization strategies gleaned from biological evolution , 1985, Nature.

[21]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[22]  K. De Jong Adaptive System Design: A Genetic Approach , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  A. Ulph Recent Advances in Oligopoly Theory from a Game Theory Perspective , 1987 .