Robot learning by demonstration using forward models of schema-based behaviors

A significant challenge in designing robot systems that learn from a teacher’s demonstration is the ability to map the perceived behavior of the trainer to an existing set of primitive behaviors. A main difficulty is that the observed actions may constitute a combination of individual behaviors’ outcomes, which would require a decomposition of the observation onto multiple primitive behaviors. This paper presents an approach to robot learning by demonstration that uses a potential-field behavioral representation to learn tasks composed by superposition of behaviors. The method allows a robot to infer essential aspects of the demonstrated tasks, which could not be captured if combinations of behaviors would not have been considered. We validate our approach in a simulated environment with a Pioneer 3DX mobile robot.

[1]  Michael A. Arbib,et al.  Schema theory , 1998 .

[2]  Sorin Moga,et al.  From Perception-Action Loops to Imitation Processes: A Bottom-Up Approach of Learning by Imitation , 1998, Appl. Artif. Intell..

[3]  Gillian M. Hayes,et al.  A Robot Controller Using Learning by Imitation , 1994 .

[4]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[5]  Ronald C. Arkin,et al.  Motor schema based navigation for a mobile robot: An approach to programming by behavior , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[6]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[7]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[8]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[9]  Richard T. Vaughan,et al.  The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[10]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[11]  Monica N. Nicolescu,et al.  Natural methods for robot task learning: instructive demonstrations, generalization and practice , 2003, AAMAS '03.

[12]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[13]  Stefano Caselli,et al.  Leveraging on a virtual environment for robot programming by demonstration , 2004, Robotics Auton. Syst..