Real-time imitation of human whole-body motions by humanoids

In this paper, we present a system that enables humanoid robots to imitate complex whole-body motions of humans in real time. In our approach, we use a compact human model and consider the positions of the end-effectors as well as the center of mass as the most important aspects to imitate. Our system actively balances the center of mass over the support polygon to avoid falls of the robot, which would occur when using direct imitation. For every point in time, our approach generates a statically stable pose. Hereby, we do not constrain the configurations to be in double support. Instead, we allow for changes of the support mode according to the motions to imitate. To achieve safe imitation, we use retargeting of the robot's feet if necessary and find statically stable configurations by inverse kinematics. We present experiments using human data captured with an Xsens MVN motion capture system. The results show that a Nao humanoid is able to reliably imitate complex whole-body motions in real time, which also include extended periods of time in single support mode, in which the robot has to balance on one foot.

[1]  Rajesh P. N. Rao,et al.  Learning to Walk through Imitation , 2007, IJCAI.

[2]  Ales Ude,et al.  Enabling real-time full-body imitation: a natural way of transferring human movement to humanoids , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  Atsushi Nakazawa,et al.  Learning from Observation Paradigm: Leg Task Models for Enabling a Biped Humanoid Robot to Imitate Human Dances , 2007, Int. J. Robotics Res..

[4]  Jun Morimoto,et al.  Motion capture and reinforcement learning of dynamically stable humanoid movement primitives , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  Kazuhito Yokoi,et al.  Generating whole body motions for a biped humanoid robot from captured human dances , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[6]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[7]  Katsu Yamane,et al.  Control-aware mapping of human motion data with stepping for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Maren Bennewitz,et al.  Whole-body imitation of human motions with a Nao humanoid , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  J. Hodgins,et al.  Optimizing Human Motion for the Control of a Humanoid Robot , 2002 .

[10]  Tamim Asfour,et al.  Imitation of human motion on a humanoid robot using non-linear optimization , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[11]  Luis Miguel Bergasa,et al.  Complete Low-Cost Implementation of a Teleoperated Control System for a Humanoid Robot , 2013, Sensors.

[12]  Behzad Dariush,et al.  Online Transfer of Human Motion to Humanoids , 2009, Int. J. Humanoid Robotics.

[13]  Eiichi Yoshida,et al.  On human motion imitation by humanoid robot , 2008, 2008 IEEE International Conference on Robotics and Automation.

[14]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant manipulators , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[15]  ChangHwan Kim,et al.  Stable whole-body motion generation for humanoid robots to imitate human motions , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Ales Ude,et al.  Programming full-body movements for humanoid robots by observation , 2004, Robotics Auton. Syst..

[17]  C. Stanton,et al.  Teleoperation of a humanoid robot using full-body motion capture , example movements , and machine learning , 2012 .

[18]  Katsu Yamane,et al.  Controlling humanoid robots with human motion data: Experimental validation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.