A curiosity model for artificial agents

Curiosity is an inherent characteristic of the animal instinct, which stimulates the need to obtain further knowledge and leads to the exploration of the surrounding environment. In this document we present a computational curiosity model, which aims at simulating that kind of behavior on artificial agents. This model is influenced by the two main curiosity theories defended by psychologists – Curiosity Drive Theory and Optimal Arousal Model. By merging both theories, as well as aspects from other sources, we concluded that curiosity can be defined in terms of the agent’s personality, its level of arousal, and the interest of the object of curiosity. The interest factor is defined in terms of the importance of the object of curiosity to the agent’s goals, its novelty, and surprise. To assess the performance of the model in practice, we designed a scenario consisting of virtual agents exploring a tile-based world, where objects may exist. The performance of the model in this scenario was evaluated in incre...

[1]  Jürgen Leitner,et al.  Curiosity driven reinforcement learning for motion planning on humanoids , 2014, Front. Neurorobot..

[2]  D. Berlyne.  NOVELTY AND CURIOSITY AS DETERMINANTS OF EXPLORATORY BEHAVIOUR1 , 1950 .

[3]  Pierre-Yves Oudeyer,et al.  Information-seeking, curiosity, and attention: computational and neural mechanisms , 2013, Trends in Cognitive Sciences.

[4]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[5]  W. Wundt,et al.  Grundzüge der physiologischen psyhcologie , 1893 .

[6]  W. Penny,et al.  Analysis of variance , 2007 .

[7]  R. Byrne,et al.  Animal curiosity , 2013, Current Biology.

[8]  Shakir Mohamed,et al.  Variational Information Maximisation for Intrinsically Motivated Reinforcement Learning , 2015, NIPS.

[9]  G. Loewenstein.  The psychology of curiosity: A review and reinterpretation. , 1994 .

[10]  J. F. Howell,et al.  Pairwise Multiple Comparison Procedures with Unequal N’s and/or Variances: A Monte Carlo Study , 1976 .

[11]  Jurgen Schmidhuber,et al.  Artificial curiosity with planning for autonomous perceptual and cognitive development , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[12]  John S. Gero,et al.  Curious agents and situated design evaluations , 2004, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[13]  Jordan A. Litman,et al.  The Measurement of Curiosity As a Feeling of Deprivation , 2004, Journal of personality assessment.

[14]  A. Cardoso,et al.  The role of Surprise, Curiosity and Hunger on Exploration of Unknown Environments Populated with Entities , 2005, 2005 portuguese conference on artificial intelligence.

[15]  John S. Gero.  A CURIOUS DESIGN AGENT A Computational Model of Novelty-Seeking Behaviour in Design , 2001 .

[16]  J. Schmidhuber.  What''s interesting? , 1997 .

[17]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[18]  F. Fincham,et al.  Curiosity and Exploration: Facilitating Positive Subjective Experiences and Personal Growth Opportunities , 2004, Journal of personality assessment.

[19]  Welch Bl.  THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED , 1947 .

[20]  Jürgen Schmidhuber,et al.  Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010) , 2010, IEEE Transactions on Autonomous Mental Development.

[21]  Frank D. Naylor,et al.  A State‐Trait Curiosity Inventory , 1981 .