Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids

We seek intuitive, efficient ways to create and direct human-like behaviors for humanoid robots. Here we present a method to enable humanoid robots to acquire movements by imitation. The robot uses 3D vision to perceive the movements of a human teacher, and then estimates the teacher's body postures using a fast full-body inverse kinematics method that incorporates a kinematic model of the teacher. This solution is then mapped to the robot and reproduced in real-time. The robustness of the method is tested on a 30-degree-of-freedom Sarcos humanoid robot located at ATR using 3D vision data from external cameras and from head-mounted cameras.

[1]  David C. Brogan,et al.  Animating human athletics , 1995, SIGGRAPH.

[2]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[3]  Peter Bakker,et al.  Robot see, robot do: An overview of robot imitation , 1996 .

[4]  Sung Yong Shin,et al.  Computer puppetry: An importance-based approach , 2001, TOGS.

[5]  J. Piaget.  Play, dreams and imitation in childhood , 1951 .

[6]  Ales Ude,et al.  Robust estimation of human body kinematics from video , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[7]  Ales Ude,et al.  Online tracking and mimicking of human movements by a humanoid robot , 2003, Adv. Robotics.

[8]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[9]  Maja J. Mataric,et al.  Getting Humanoids to Move and Imitate , 2000, IEEE Intell. Syst..

[10]  Stefan Schaal,et al.  Inverse kinematics for humanoid robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Christopher G. Atkeson,et al.  Methods for Motion Generation and Interaction with a Humanoid Robot: Case Studies of Dancing and Catching , 2000 .

[12]  C. Breazeal,et al.  Challenges in building robots that imitate people , 2002 .

[13]  Kerstin Dautenhahn,et al.  Challenges in Building Robots That Imitate People , 2002 .

[14]  Norman I. Badler,et al.  Inverse kinematics positioning using nonlinear programming for highly articulated figures , 1994, TOGS.