The Role of Implicit Motives in Strategic Decision-Making: Computational Models of Motivated Learning and the Evolution of Motivated Agents

Individual behavioral differences in humans have been linked to measurable differences in their mental activities, including differences in their implicit motives. In humans, individual differences in the strength of motives such as power, achievement and affiliation have been shown to have a significant impact on behavior in social dilemma games and during other kinds of strategic interactions. This paper presents agent-based computational models of power-, achievement- and affiliation-motivated individuals engaged in game-play. The first model captures learning by motivated agents during strategic interactions. The second model captures the evolution of a society of motivated agents. It is demonstrated that misperception, when it is a result of motivation, causes agents with different motives to play a given game differently. When motivated agents who misperceive a game are present in a population, higher explicit payoff can result for the population as a whole. The implications of these results are discussed, both for modeling human behavior and for designing artificial agents with certain salient behavioral characteristics.

[1]  Pierre-Yves Oudeyer,et al.  Intelligent Adaptive Curiosity: a source of Self-Development , 2004 .

[2]  Marco Mirolli,et al.  Evolution and Learning in an Intrinsically Motivated Reinforcement Learning Robot , 2007, ECAL.

[3]  Howard M. Schwartz,et al.  Swarm Robot Systems Based on the Evolution of Personality Traits , 2007 .

[4]  Kathryn E. Merrick,et al.  Evolution of intrinsic motives in a multi-player common pool resource game , 2014, 2014 IEEE Symposium on Computational Intelligence for Human-like Intelligence (CIHLI).

[5]  Jutta Heckhausen,et al.  Motivation and action , 1991 .

[6]  A. Elliot,et al.  Approach–Avoidance Motivation and Emotion: Convergence and Divergence , 2013 .

[7]  J. W. Atkinson,et al.  Achievement motive and test anxiety conceived as motive to approach success and motive to avoid failure. , 1960, Journal of abnormal and social psychology.

[8]  Francesco Mannella,et al.  Intrinsically motivated action-outcome learning and goal-based action recall: a system-level bio-constrained computational model. , 2013, Neural networks : the official journal of the International Neural Network Society.

[9]  Robert C. Davis,et al.  The Achieving Society , 1962 .

[10]  Keith W. Hipel,et al.  Modeling misperceptions in games , 1988 .

[11]  P. Richerson,et al.  The evolution of indirect reciprocity , 1989 .

[12]  Kathryn E. Merrick,et al.  Motivated Reinforcement Learning - Curious Characters for Multiuser Games , 2009 .

[13]  Drew Fudenberg,et al.  Learning in Games: Where Do We Stand , 1998 .

[14]  Kathryn B. Laskey,et al.  Game Theory and Experimental Games: The Study of Strategic Interaction , 1984 .

[15]  John W. Atkinson,et al.  Motivation and achievement , 1974 .

[16]  Brumley Lachlan.  Misperception and its evolutionary value , 2014 .

[17]  D. M. Kuhlman,et al.  Expectations of choice behavior held by cooperators, competitors, and individualists across four classes of experimental games. , 1976 .

[18]  Kathryn E. Merrick,et al.  A game theoretic framework for incentive-based models of intrinsic motivation in artificial systems , 2013, Front. Psychol..

[19]  Wim B. G. Liebrand,et al.  The effects of social motives on behavior in social dilemmas in two cultures. , 1985 .

[20]  Pierre-Yves Oudeyer,et al.  Socially guided intrinsic motivation for robot learning of motor skills , 2014, Auton. Robots.

[21]  Kenneth W. Terhune,et al.  Motives, situation, and interpersonal conflict within Prisoner's Dilemma. , 1968 .

[22]  J. W. Atkinson.  Motivational determinants of risk-taking behavior. , 1957, Psychological review.

[23]  Drew Fudenberg,et al.  Learning in Games , 1998 .

[24]  Peter Stone,et al.  Multiagent learning in the presence of memory-bounded agents , 2013, Autonomous Agents and Multi-Agent Systems.

[25]  S. Kokubo,et al.  Universal scaling for the dilemma strength in evolutionary games. , 2015, Physics of life reviews.

[26]  D. Mcclelland,et al.  Leadership motive pattern and long-term success in management. , 1982 .

[27]  Richard L. Lewis,et al.  Intrinsically Motivated Reinforcement Learning: An Evolutionary Perspective , 2010, IEEE Transactions on Autonomous Mental Development.

[28]  Marco Mirolli,et al.  Intrinsically Motivated Learning in Natural and Artificial Systems , 2013 .

[29]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[30]  A. Freund,et al.  When wanting and fearing go together: The effect of co-occurring social approach and avoidance motivation on behavior, affect, and cognition , 2009 .

[31]  D. M. Kuhlman,et al.  Individual differences in game motivation as moderators of preprogrammed strategy effects in prisoner's dilemma. , 1975, Journal of personality and social psychology.

[32]  A. Rapoport,et al.  Prisoner's Dilemma: A Study in Conflict and Co-operation , 1970 .

[33]  D C McClelland,et al.  Power motivation and risk-taking behavior. , 1973, Journal of personality.

[34]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[35]  Jeffrey C. Ely,et al.  Evolution of Preferences , 2007 .

[36]  Daron Acemoglu,et al.  Evolution of Perceptions and Play , 2001 .

[37]  E. Bennett.  The aspiration approach to predicting coalition formation and payoff distribution in sidepayment games , 1983 .

[38]  F. Richard Ferraro,et al.  Handbook of Approach and Avoidance Motivation , 2010 .

[39]  Kathryn E. Merrick,et al.  Achievement, affiliation, and power: Motive profiles for artificial agents , 2011, Adapt. Behav..