Controlling humanoid robots with human motion data: Experimental validation

Motion capture is a good source of data for programming humanoid robots because it contains the natural styles and synergies of human behaviors. However, it is difficult to directly use captured motion data because the kinematics and dynamics of humanoid robots differ significantly from those of humans. In our previous work, we developed a controller that allows a robot to maintain balance while tracking a given reference motion that does not include contact state changes. The controller consists of a balance controller based on a simplified robot model and a tracking controller that performs local joint feedback and an optimization process to obtain the joint torques to simultaneously realize balancing and tracking. In this paper, we improve the controller to address the issues related to root position/orientation estimation, model uncertainties, and the difference between expected and actual contact forces. We implement the controller on a full-body, force-controlled humanoid robot. Experimental results demonstrate that the controller can successfully make the robot track captured human motion sequences.

[1]  Jovan Popovic,et al.  Simulation of Human Motion Data using Short‐Horizon Model‐Predictive Control , 2008, Comput. Graph. Forum.

[2]  Taku Komura,et al.  The dynamic postural adjustment with the quadratic programming method , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Marco da Silva,et al.  Interactive simulation of stylized human locomotion , 2008, ACM Trans. Graph..

[4]  Gentiane Venture,et al.  Identification of humanoid robots dynamics using floating-base motion dynamics , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Atsushi Nakazawa,et al.  Learning from Observation Paradigm: Leg Task Models for Enabling a Biped Humanoid Robot to Imitate Human Dances , 2007, Int. J. Robotics Res..

[6]  Zoran Popović,et al.  Contact-aware nonlinear control of dynamic characters , 2009, SIGGRAPH 2009.

[7]  J. Y. S. Luh,et al.  Resolved-acceleration control of mechanical manipulators , 1980 .

[8]  Katsu Yamane,et al.  Control-aware mapping of human motion data with stepping for humanoid robots , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[10]  Katsu Yamane,et al.  Simultaneous tracking and balancing of humanoid robots for imitating human motion capture data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Stefan Schaal,et al.  Inverse dynamics control of floating base systems using orthogonal decomposition , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[13]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jehee Lee,et al.  Simulating biped behaviors from human motion data , 2007, SIGGRAPH 2007.

[15]  Benjamin J. Stephens Integral control of humanoid balance , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.