Motion Retargeting for Humanoid Robots Based on Simultaneous Morphing Parameter Identification and Motion Optimization

This paper presents a novel method for retargeting human motions onto a humanoid robot. The method solves the following three simultaneous problems: the geometric parameter identification that morphs the human model to the robot model, motion planning for a robot, and the inverse kinematics of the human motion-capture data. Simultaneous solutions can imitate the original motion more accurately than conventional approaches, which solve the problems sequentially. The proposed method can reconstruct the human motion within the physical constraints imposed by robot dynamics. A reconstruction step enables quantitative analysis of the retargeting results through direct comparison with the original human motion. The method can also provide the precise morphing function as well as subject-specific models, which can handle the different body dimensions of human subjects. This new framework is suitable for applications that require an accurate generation of human-like motions with quantitative evaluation criteria, such as humanoid robots that evaluate assistive devices. Experimental tests of the proposed method were performed with humanoid robot HRP-4.

[1]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[2]  Eiichi Yoshida,et al.  Motion retargeting for humanoid robots based on identification to preserve and reproduce human motion features , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Hiroshi Ishiguro,et al.  On the human perception of dissimilarities between postures of humanoids , 2016, Adv. Robotics.

[4]  Eiichi Yoshida,et al.  New evaluation framework for human-assistive devices based on humanoid robotics , 2016, Adv. Robotics.

[5]  M Vukobratović,et al.  On the stability of biped locomotion. , 1970, IEEE transactions on bio-medical engineering.

[6]  Eiichi Yoshida,et al.  Stationary torque replacement for evaluation of active assistive devices using humanoid , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[7]  Eiichi Yoshida,et al.  Forward dynamics simulation of human figures on assistive devices using geometric skin deformation model , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Eiichi Yoshida,et al.  Optimization-based motion retargeting integrating spatial and dynamic constraints for humanoid , 2013, IEEE ISR 2013.

[9]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[10]  Katsu Yamane,et al.  Controlling humanoid robots with human motion data: Experimental validation , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[11]  Sahan Gamage,et al.  New least squares solutions for estimating the average centre of rotation and the axis of rotation. , 2002, Journal of biomechanics.

[12]  Taku Komura,et al.  Interaction mesh based motion adaptation for biped humanoid robots , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[13]  Y. Nakamura,et al.  Somatosensory computation for man-machine interface from motion-capture data and musculoskeletal human model , 2005, IEEE Transactions on Robotics.

[14]  David A. Forsyth,et al.  Skeletal parameter estimation from optical motion capture data , 2004, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Atsuo Takanishi,et al.  Development of walking support system based on dynamic simulation , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[16]  Shuuji Kajita,et al.  Cybernetic human HRP-4C , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[17]  Behzad Dariush,et al.  Online Transfer of Human Motion to Humanoids , 2009, Int. J. Humanoid Robotics.

[18]  Hirochika Inoue,et al.  Real-time humanoid motion generation through ZMP manipulation based on inverted pendulum control , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[19]  Eiichi Yoshida,et al.  Humanoid robot as an evaluator of assistive devices , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Mitsuharu Morisawa,et al.  Humanoid robot HRP-4 - Humanoid robotics platform with lightweight and slim body , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Yoshihiko Nakamura,et al.  Fast inverse kinematics algorithm for large DOF system with decomposed gradient computation based on recursive formulation of equilibrium , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[23]  Nicolas Mansard,et al.  Dynamic motion capture and edition using a stack of tasks , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[24]  Atsushi Nakazawa,et al.  Learning from Observation Paradigm: Leg Task Models for Enabling a Biped Humanoid Robot to Imitate Human Dances , 2007, Int. J. Robotics Res..

[25]  Kazuhito Yokoi,et al.  The 3D linear inverted pendulum mode: a simple modeling for a biped walking pattern generation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[26]  Gentiane Venture,et al.  Identifiability and identification of inertial parameters using the underactuated base-link dynamics for legged multibody systems , 2014, Int. J. Robotics Res..

[27]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[28]  Takayuki Tanaka,et al.  Motion-Based-Design of Elastic Material for Passive Assistive Device Using Musculoskeletal Model , 2011, J. Robotics Mechatronics.

[29]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[30]  David E. Orin,et al.  Kinodynamically Consistent Motion Retargeting for Humanoids , 2015, Int. J. Humanoid Robotics.

[31]  Kyungdon Joo,et al.  Robot System of DRC‐HUBO+ and Control Strategy of Team KAIST in DARPA Robotics Challenge Finals , 2017, J. Field Robotics.

[32]  Shuuji Kajita,et al.  Robot motion remix based on motion capture data towards human-like locomotion of humanoid robots , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[33]  Yoshihiko Nakamura,et al.  Simultaneous global inverse kinematics and geometric parameter identification of human skeletal model from motion capture data , 2014 .