Effects of social exploration mechanisms on robot learning

Social learning in robotics has largely focused on imitation learning. Here we take a broader view and are interested in the multifaceted ways that a social partner can influence the learning process. We implement four social learning mechanisms on a robot: stimulus enhancement, emulation, mimicking, and imitation, and illustrate the computational benefits of each. In particular, we illustrate that some strategies are about directing the attention of the learner to objects and others are about actions. Taken together these strategies form a rich repertoire allowing social learners to use a social partner to greatly impact their learning process. We demonstrate these results in simulation and with physical robot ‘playmates’.

[1]  Maya Cakmak,et al.  To Afford or Not to Afford: A New Formalization of Affordances Toward Affordance-Based Robot Control , 2007, Adapt. Behav..

[2]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[3]  Aude Billard,et al.  Imitation: a Means to Enhance Learning of a Synthetic Proto-language in an Autonomous Robot , 1999 .

[4]  Cynthia Breazeal,et al.  A simulation-theory inspired social learning system for interactive characters , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[5]  Maya Cakmak,et al.  Computational benefits of social learning mechanisms: Stimulus enhancement and emulation , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[6]  M. Tomasello.  The Cultural Origins of Human Cognition , 2000 .

[7]  M. Veloso,et al.  Multiagent Collaborative Task Learning through Imitation , 2007 .

[8]  Bruce Blumberg,et al.  Integrated learning for interactive synthetic characters , 2002, SIGGRAPH.

[9]  R. Dillmann,et al.  Towards life-long learning in household robots: The Piagetian approach , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[10]  Stefan Schaal,et al.  Learning and generalization of motor skills by learning from demonstration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[11]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[12]  M. Carpenter,et al.  Three sources of information in social learning , 2002 .

[13]  Manuel Lopes,et al.  Learning Object Affordances: From Sensory--Motor Coordination to Imitation , 2008, IEEE Transactions on Robotics.

[14]  Maya Cakmak,et al.  Learning about objects with human teachers , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  R. Amit,et al.  Learning movement sequences from demonstration , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[16]  K. Dautenhahn,et al.  The correspondence problem , 2002 .

[17]  Aude Billard,et al.  A probabilistic Programming by Demonstration framework handling constraints in joint space and task space , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Chrystopher L. Nehaniv,et al.  Imitation as a Dual-Route Process Featuring Predictive and Learning Components: A Biologically Plausible Computational Model , 2002 .