How can we define intrinsic motivation

Intrinsic motivation is a crucial mechanism for open-ended cognitive development since it is the driver of spontaneous exploration and curiosity. Yet, it has so far only been conceptualized in ad hoc manners in the epigenetic robotics community. After reviewing different approaches to intrinsic motivation in psychology, this paper presents a unified definition of intrinsic motivation, based on the theory of Daniel Berlyne. Based on this definition, we propose a landscape of types of computational approaches, making it possible to position existing and future models relative to each other, and we show that important approaches are still to be explored.

[1]  C. L. Hull Principles of behavior : an introduction to behavior theory , 1943 .

[2]  H. Harlow Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys. , 1950, Journal of comparative and physiological psychology.

[3]  Harlow Hf Learning and satiation of response in intrinsically motivated complex puzzle performance by monkeys. , 1950 .

[4]  K. Montgomery The role of the exploratory drive in learning. , 1954, Journal of comparative and physiological psychology.

[5]  W. N. Dember,et al.  Analysis of exploratory, manipulatory, and curiosity behaviors. , 1957, Psychological review.

[6]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .

[7]  R. W. White Motivation reconsidered: the concept of competence. , 1959, Psychological review.

[8]  D. Berlyne,et al.  Structure and direction in thinking , 1965 .

[9]  David Elkind,et al.  Learning: An Introduction , 1968 .

[10]  R. Decharms Personal causation : the internal affective determinants of behavior , 1968 .

[11]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[12]  J. Kagan Motives and development. , 1972, Journal of personality and social psychology.

[13]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[14]  K. Miller,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[15]  J. Crutchfield Information and Its Metric , 1990 .

[16]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[17]  Sebastian Thrun,et al.  Exploration in active learning , 1998 .

[18]  Doina Precup,et al.  Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning , 1999, Artif. Intell..

[19]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[20]  Andrew McCallum,et al.  Toward Optimal Active Learning through Monte Carlo Estimation of Error Reduction , 2001, ICML 2001.

[21]  Xiao Huang,et al.  Novelty and Reinforcement Learning in the Value System of Developmental Robots , 2002 .

[22]  Pierre-Yves Oudeyer,et al.  Motivational principles for visual know-how development , 2003 .

[23]  Christopher G. Prince,et al.  Taking Synchrony Seriously: A Perceptual-Level Model of Infant Synchrony Detection , 2004 .

[24]  Nuttapong Chentanez,et al.  Intrinsically Motivated Learning of Hierarchical Collections of Skills , 2004 .

[25]  Philippe Gaussier,et al.  Learning Invariant Sensorimotor Behaviors: A Developmental Approach to Imitation Mechanisms , 2004, Adapt. Behav..

[26]  Douglas S. Blank,et al.  An Emergent Framework For Self-Motivation In Developmental Robotics , 2004 .

[27]  Juergen Konczak,et al.  Fourth International Workshop on Epigenetic Robotics: Modeling Cognitive Development in Robotic Systems , 2004, Cognitive Systems Research.

[28]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[29]  A. Barto,et al.  Intrinsic Motivation For Reinforcement Learning Systems , 2005 .

[30]  Olaf Sporns,et al.  Evolving Coordinated Behavior by Maximizing Information Structure , 2006 .

[31]  Pierre-Yves Oudeyer,et al.  Discovering communication , 2006, Connect. Sci..

[32]  Andrea Bonarini,et al.  Self-Development Framework for Reinforcement Learning Agents , 2006 .

[33]  G. Baldassarre,et al.  Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[34]  Philippe Capdepuy,et al.  Maximization of Potential Information Flow as a Universal Utility for Collective Behaviour , 2007, 2007 IEEE Symposium on Artificial Life.

[35]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[36]  Pierre-Yves Oudeyer,et al.  What is Intrinsic Motivation? A Typology of Computational Approaches , 2007, Frontiers Neurorobotics.

[37]  Kathryn E. Merrick,et al.  Motivated Learning from Interesting Events: Adaptive, Multitask Learning Agents for Complex Environments , 2009, Adapt. Behav..