Evolution of Intrinsic Motives in Multi-agent Simulations

In humans, intrinsic motives help us to identify, prioritize, select and adapt the goals we will pursue. A variety of computational models of intrinsic motives have been developed for artificial agents including curiosity, achievement, affiliation and power motivation. Previous research has focused on using models of intrinsic motivation in individual agents, such as developmental robots or virtual agents. However, in humans, intrinsic motives evolve over time in response to personal and social factors. This paper presents evolutionary models of intrinsically motivated agents. The models are evaluated in multi-agent simulations of agents playing iterated prisoner's dilemma games.

[1]  Kathryn E. Merrick,et al.  A computational model of achievement motivation for artificial agents , 2011, AAMAS.

[2]  Jutta Heckhausen,et al.  Motivation and action , 1991 .

[3]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[4]  Rob Saunders,et al.  Curious Design Agents and Artificial Creativity - A Synthetic Approach to the Study of Creative Behaviour , 2001 .

[5]  Jutta Heckhausen,et al.  Motivation and action (2nd ed.). , 2008 .

[6]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[7]  Pierre-Yves Oudeyer,et al.  What is Intrinsic Motivation? A Typology of Computational Approaches , 2007, Frontiers Neurorobotics.

[8]  Kenneth W. Terhune,et al.  Motives, situation, and interpersonal conflict within Prisoner's Dilemma. , 1968 .

[9]  Kathryn E. Merrick,et al.  Motivated Reinforcement Learning - Curious Characters for Multiuser Games , 2009 .

[10]  Gianluca Baldassarre,et al.  What are intrinsic motivations? A biological perspective , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[11]  Kathryn E. Merrick,et al.  Achievement, affiliation, and power: Motive profiles for artificial agents , 2011, Adapt. Behav..

[12]  A. Rapoport,et al.  Prisoner's Dilemma: A Study in Conflict and Co-operation , 1970 .

[13]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .