An Exploration of Differential Utility in Iterated Prisoner's Dilemma

While prisoner's dilemma has frequently been used in studies of animal behavior, past work in the area fails to address the question of differential utility. As animals needs change, their behavior also changes. A hungry animal may be less likely to cooperate than a full one. In this study an abstract species is modelled using an energy balance computation that assigns a state of hungry, full, or neither to a given animal together with a modified finite state representation for a prisoner's dilemma strategy that implements distinct but linked strategies for each possible state. The strategy used is conditioned on the animal's current hunger state. An evolutionary algorithm is used to generate effective strategies for this deterministic form of differential utility prisoner's dilemma. A tool called fingerprinting is used to document the strategies that arise. It is shown that the strategies that arise for the three possible hunger states have different distributions among known strategies and also differ from a baseline experiment in which agents are evolved to play prisoner's dilemma without any form of differential utility

[1]  Daniel A. Ashlock,et al.  The impact of cellular representation on finite state agents for prisoner's dilemma , 2005, GECCO '05.

[2]  Daniel A. Ashlock,et al.  Depth Annotation of RNA Folds for Secondary Structure Motif Search , 2005, 2005 IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology.

[3]  Mark D. Smucker,et al.  Iterated Prisoner's Dilemma with Choice and Refusal of Partners: Evolutionary Results , 1995, ECAL.

[4]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[5]  L. Tesfatsion,et al.  Preferential partner selection in an evolutionary study of Prisoner's Dilemma. , 1994, Bio Systems.

[6]  Daniel A. Ashlock,et al.  Fingerprints: enabling visualization and automatic analysis of strategies for two player games , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[7]  S. Resnick Adventures in stochastic processes , 1992 .

[8]  N. Leahy,et al.  A representational sensitivity study of game theoretic simulations , 2003, Proceedings of the 2003 IEEE International Workshop on Soft Computing in Industrial Applications, 2003. SMCia/03..

[9]  Daniel A. Ashlock,et al.  Nonlinear projection for the display of high dimensional distance data , 2005, 2005 IEEE Congress on Evolutionary Computation.