A Developmental Roadmap for Learning by Imitation in Robots

In this paper, we present a strategy whereby a robot acquires the capability to learn by imitation following a developmental pathway consisting on three levels: 1) sensory-motor coordination; 2) world interaction; and 3) imitation. With these stages, the system is able to learn tasks by imitating human demonstrators. We describe results of the different developmental stages, involving perceptual and motor skills, implemented in our humanoid robot, Baltazar. At each stage, the system's attention is drawn toward different entities: its own body and, later on, objects and people. Our main contributions are the general architecture and the implementation of all the necessary modules until imitation capabilities are eventually acquired by the robot. Also, several other contributions are made at each level: learning of sensory-motor maps for redundant robots, a novel method for learning how to grasp objects, and a framework for learning task description from observation for program-level imitation. Finally, vision is used extensively as the sole sensing modality (sometimes in a simplified setting) avoiding the need for special data-acquisition hardware

[1]  T. Bower A primer of infant development , 1977 .

[2]  J. Gibson The Ecological Approach to Visual Perception , 1979 .

[3]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[4]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[5]  V. G. Payne,et al.  Human Motor Development: A Lifespan Approach , 1987 .

[6]  R. Fletcher Practical Methods of Optimization , 1988 .

[7]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.

[8]  Claude Samson,et al.  Robot Control: The Task Function Approach , 1991 .

[9]  Minoru Asada,et al.  Versatile visual servoing without knowledge of true Jacobian , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[10]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[11]  AL van der Meer,et al.  The functional significance of arm movements in neonates , 1995, Science.

[12]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[13]  Randal C. Nelson,et al.  On-line Estimation of Visual-Motor Models using Active Vision , 1996 .

[14]  G Rizzolatti,et al.  The Space Around Us , 1997, Science.

[15]  John Juyang Weng The Developmental Approach to Intelligent Robots , 1998 .

[16]  Giorgio Metta,et al.  BabyRoBot: A study in sensori-motor development , 1999 .

[17]  P. Rochat,et al.  To reach or not to reach? Perception of body effectivities by young infants , 1999 .

[18]  Cynthia Breazeal,et al.  Toward Teaching a Robot "Infant" using Emotive Communication Acts , 1999 .

[19]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[20]  Stefan Schaal,et al.  Locally Weighted Projection Regression : An O(n) Algorithm for Incremental Real Time Learning in High Dimensional Space , 2000 .

[21]  Minoru Asada,et al.  Cognitive developmental robotics as a new paradigm for the design of humanoid robots , 2001, Robotics Auton. Syst..

[22]  Jeremy L. Wyatt,et al.  Advances in Robot Learning , 2001, Lecture Notes in Computer Science.

[23]  Oliver Brock,et al.  Human-Centered Robotics and Interactive Haptic Simulation , 2001, ISRR.

[24]  Chrystopher L. Nehaniv,et al.  Like Me?- Measures of Correspondence and Imitation , 2001, Cybern. Syst..

[25]  P. E. Hotz,et al.  Evolving the morphology of a neural network for controlling a foveating retina: and its test on a real robot , 2002 .

[26]  Chrystopher L. Nehaniv,et al.  Imitation with ALICE: learning to imitate corresponding actions across dissimilar embodiments , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[27]  M. Asada,et al.  A developmental approach accelerates learning of joint attention , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[28]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[29]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[30]  Kazuhito Yokoi,et al.  Generating whole body motions for a biped humanoid robot from captured human dances , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[31]  Giulio Sandini,et al.  Developmental robotics: a survey , 2003, Connect. Sci..

[32]  Artur Miguel Do Amaral Arsénio,et al.  Cognitive-developmental learning for a humanoid robot: a caregiver's gift , 2004 .

[33]  Manuel Lopes,et al.  An anthropomorphic robot torso for imitation: design and experiments , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[34]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[35]  Nicolas Mansard,et al.  Tasks sequencing for visual servoing , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[36]  Gordon Cheng,et al.  Discovering optimal imitation strategies , 2004, Robotics Auton. Syst..

[37]  E. Birch,et al.  Measurement of stereoacuity outcomes at ages 1 to 24 months: Randot Stereocards. , 2005, Journal of AAPOS : the official publication of the American Association for Pediatric Ophthalmology and Strabismus.

[38]  José Santos-Victor,et al.  Visual learning by imitation with motor representations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  José Santos-Victor,et al.  Learning Sensory-Motor Maps for Redundant Robots , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[40]  Manuel Lopes,et al.  Jacobian Learning Methods for Tasks Sequencing in Visual Servoing , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Yiannis Demiris,et al.  Hierarchical attentive multiple models for execution and recognition of actions , 2006, Robotics Auton. Syst..

[42]  Katherine D. Kinzler,et al.  Core knowledge. , 2007, Developmental science.