Robots Show Us How to Teach Them: Feedback from Robots Shapes Tutoring Behavior during Action Learning

Robot learning by imitation requires the detection of a tutor's action demonstration and its relevant parts. Current approaches implicitly assume a unidirectional transfer of knowledge from tutor to learner. The presented work challenges this predominant assumption based on an extensive user study with an autonomously interacting robot. We show that by providing feedback, a robot learner influences the human tutor's movement demonstrations in the process of action learning. We argue that the robot's feedback strongly shapes how tutors signal what is relevant to an action and thus advocate a paradigm shift in robot action learning research toward truly interactive systems learning in and benefiting from interaction.

[1]  K. Dautenhahn,et al.  Imitation in Animals and Artifacts , 2002 .

[2]  Paul J. Thibault,et al.  First-Order Languaging Dynamics and Second-Order Language: The Distributed Language View , 2011 .

[3]  E. D. Paolo,et al.  Can social interaction constitute social cognition? , 2010, Trends in Cognitive Sciences.

[4]  G. Csibra,et al.  Teleological reasoning in infancy: the naı̈ve theory of rational action , 2003, Trends in Cognitive Sciences.

[5]  A. Whiten,et al.  Causal knowledge and imitation/emulation switching in chimpanzees (Pan troglodytes) and children (Homo sapiens) , 2005, Animal Cognition.

[6]  Kensy Cooperrider.  Roots of human sociality: culture, cognition and interaction , 2009 .

[7]  Stephanie Rosenthal,et al.  How robots' questions affect the accuracy of the human responses , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[8]  Manfred Tscheligi,et al.  A case study on the effect of feedback on itinerary requests in human-robot interaction , 2011, 2011 RO-MAN.

[9]  Jochen J. Steil,et al.  Interactive imitation learning of object movement skills , 2011, Autonomous Robots.

[10]  Kerstin Dautenhahn,et al.  New Frontiers in Human-Robot Interaction , 2011 .

[11]  Katharina J. Rohlfing,et al.  Developing feedback: How children of different age contribute to a tutoring interaction with adults , 2010, 2010 IEEE 9th International Conference on Development and Learning.

[12]  Anna-Lisa Vollmer,et al.  Robot feedback shapes the tutor’s presentation: How a robot’s online gaze strategies lead to micro-adaptation of the human’s conduct , 2013 .

[13]  D. Vernon,et al.  Development and Learning , 2014 .

[14]  Katharina J. Rohlfing,et al.  Computational Analysis of Motionese Toward Scaffolding Robot Action Learning , 2009, IEEE Transactions on Autonomous Mental Development.

[15]  S. Levinson,et al.  Roots of Human Sociality , 2006 .

[16]  Michael Tomasello,et al.  Push or Pull: Imitation vs. Emulation in Great Apes and Human Children , 2006 .

[17]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[18]  A. Cangelosi,et al.  Demonstrating actions to a robot : How naı̈ve users adapt to a robot ’ s replication of goal and manner-oriented actions , 2013 .

[19]  Aude Billard,et al.  A framework integrating statistical and social cues to teach a humanoid robot new skills , 2008, ICRA 2008.

[20]  A. Thomaz,et al.  Transparent active learning for robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  C. Breazeal,et al.  Transparency and Socially Guided Machine Learning , 2006 .

[22]  C. Breazeal,et al.  Robot learning via socially guided exploration , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[23]  Nicholas J. Butko,et al.  Active perception , 2010 .

[24]  K. Rohlfing,et al.  On the loop of action modification and the recipient's gaze in adult-child interaction , 2009 .

[25]  K. Rohlfing,et al.  People modify their tutoring behavior in robot-directed interaction for action learning , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[26]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[27]  Kerstin Fischer,et al.  Mindful tutors: Linguistic choice and action demonstration in speech to infants and a simulated robot , 2011 .

[28]  S. Strauss,et al.  Teaching as a natural cognition and its relations to preschoolers’ developing theory of mind , 2002 .

[29]  Katharina J. Rohlfing,et al.  How can multimodal cues from child-directed interaction reduce learning complexity in robots? , 2006, Adv. Robotics.

[30]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Maya Cakmak,et al.  Learning about objects with human teachers , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).