On Real-time Whole-body Human to Humanoid Motion Transfer

We present a framework for online imitation of human motion by the humanoid robot HRP-2. We introduce a representation of human motion, the Humanoid-Normalized model, and a Center of Mass (CoM) anticipation model to prepare the robot in case the human lifts his/her foot. Our proposed motion representation codifies operational space and geometric information. Whole body robot motion is computed using a task-based prioritized inverse kinematics solver. By setting the human motion model as the target, and giving the maintenance of robot CoM a high priority, we can achieve a large range of motion imitation. We present two scenarios of motion imitation, first where the humanoid mimics a dancing motion of the human, and second where it balances on one foot. Our results show that we can effectively transfer a large range of motion from human to humanoid. We also evaluate the tracking errors between the original and imitated motion, and consider the restrictions on the range of transferable human motions using this approach.

[1]  Franck Multon,et al.  MKM: A Global Framework for Animating Humans in Virtual Reality Applications , 2008, PRESENCE: Teleoperators and Virtual Environments.

[2]  Atsushi Nakazawa,et al.  Task model of lower body motion for a biped humanoid robot to imitate human dances , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[4]  A. E. Patla,et al.  Online steering: coordination and control of body center of mass, head and body reorientation , 1999, Experimental Brain Research.

[5]  Eiichi Yoshida,et al.  Integrating dynamics into motion planning for humanoid robots , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Behzad Dariush,et al.  Online and markerless motion retargeting with kinematic constraints , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Kwang-Jin Choi,et al.  Online motion retargetting , 2000, Comput. Animat. Virtual Worlds.

[8]  Eiichi Yoshida,et al.  On human motion imitation by humanoid robot , 2008, 2008 IEEE International Conference on Robotics and Automation.

[9]  Behzad Dariush,et al.  Whole body humanoid control from human motion descriptors , 2008, 2008 IEEE International Conference on Robotics and Automation.

[10]  Lori Ann Vallis,et al.  Children use different anticipatory control strategies than adults to circumvent an obstacle in the travel path , 2005, Experimental Brain Research.

[11]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[12]  C. S. George Lee,et al.  Whole-body human-to-humanoid motion transfer , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[13]  Katsushi Ikeuchi,et al.  Humanoid robot motion generation with sequential physical constraints , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.

[15]  Eiichi Yoshida,et al.  A Local Collision Avoidance Method for Non-strictly Convex Polyhedra , 2008, Robotics: Science and Systems.

[16]  Rajesh P. N. Rao,et al.  Robotic imitation from human motion capture using Gaussian processes , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[17]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[18]  Jean-Paul Laumond,et al.  Steering a humanoid robot by its head , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Katsu Yamane,et al.  Simultaneous tracking and balancing of humanoid robots for imitating human motion capture data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  M. Vukobratovic,et al.  On the stability of anthropomorphic systems , 1972 .

[21]  Ales Ude,et al.  Programming full-body movements for humanoid robots by observation , 2004, Robotics Auton. Syst..

[22]  Eiichi Yoshida,et al.  On Human Motion Imitation , 2007 .

[23]  Matthieu Herrb,et al.  G/sup en/oM: a tool for the specification and the implementation of operating modules in a distributed robot architecture , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[24]  Katsu Yamane,et al.  Capture Database through Symbolization, Recognition and Generation of Motion Patterns , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[25]  Matthieu Herrb,et al.  A tool for the specification and the implementation of operating modules in a distributed robot architecture , 1999 .

[26]  Kwang-Jin Choi,et al.  Online motion retargetting , 2000, Comput. Animat. Virtual Worlds.