Simultaneous tracking and balancing of humanoid robots for imitating human motion capture data

This paper presents a control framework for humanoid robots that uses all joints simultaneously to track motion capture data and maintain balance. The controller comprises two main components: a balance controller and a tracking controller. The balance controller uses a regulator designed for a simplified humanoid model to obtain the desired input to keep balance based on the current state of the robot. The simplified model is chosen so that a regulator can be designed systematically using, for example, optimal control. An example of such controller is a linear quadratic regulator designed for an inverted pendulum model. The desired inputs are typically the center of pressure and/or torques of some representative joints. The tracking controller then computes the joint torques that minimize the difference from desired inputs as well as the error from desired joint accelerations to track the motion capture data, considering exact full-body dynamics. We demonstrate that the proposed controller effectively reproduces different styles of storytelling motion using dynamics simulation considering limitations in hardware.

[1]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, ACM Trans. Graph..

[2]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..

[3]  Rajesh P. N. Rao,et al.  Robotic imitation from human motion capture using Gaussian processes , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[4]  Yoshihiko Nakamura,et al.  Embodied Symbol Emergence Based on Mimesis Theory , 2004, Int. J. Robotics Res..

[5]  Katsu Yamane,et al.  A Numerically Robust LCP Solver for Simulating Articulated Rigid Bodies in Contact , 2008, Robotics: Science and Systems.

[6]  Kazuhito Yokoi,et al.  Generating whole body motions for a biped humanoid robot from captured human dances , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[7]  Yoshihiko Nakamura,et al.  Motion capture based human motion recognition and imitation by direct marker control , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[8]  J. Y. S. Luh,et al.  Resolved-acceleration control of mechanical manipulators , 1980 .

[9]  Tomomichi Sugihara,et al.  Simulated regulator to synthesize ZMP manipulation and foot location for autonomous control of biped robots , 2008, 2008 IEEE International Conference on Robotics and Automation.

[10]  Benjamin J. Stephens.  Integral control of humanoid balance , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Hyeong-Seok Ko,et al.  Motion Balance Filtering , 2000, Comput. Graph. Forum.

[12]  Taku Komura,et al.  Stepping motion for a human-like character to maintain balance against large perturbations , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  J. Hodgins,et al.  Optimizing Human Motion for the Control of a Humanoid Robot , 2002 .

[14]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[15]  Ales Ude,et al.  Automatic Generation of Kinematic Models for the Conversion of Human Motion Capture Data into Humanoid Robot Motion , 2000 .

[16]  T. Takenaka,et al.  The development of Honda humanoid robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[17]  Jessica K. Hodgins,et al.  Motion capture-driven simulations that hit and react , 2002, SCA '02.

[18]  Yoshihiko Nakamura,et al.  Making feasible walking motion of humanoid robots from human motion capture data , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  Katsu Yamane,et al.  Online dynamical retouch of motion patterns towards animatronic humanoid robots , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[20]  Kazuhito Yokoi,et al.  Biped walking pattern generation by using preview control of zero-moment point , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[21]  Maja J. Mataric,et al.  Deriving action and behavior primitives from human motion data , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Katsu Yamane,et al.  Dynamics Simulation of Humanoid Robots : Forward Dynamics , Contact , and Experiments , 2008 .

[23]  Atsuo Takanishi,et al.  Development of a biped walking robot compensating for three-axis moment by trunk motion , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[24]  Michael Gienger,et al.  Sensor and control design of a dynamically stable biped robot , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  H. Inoue,et al.  Dynamic walking pattern generation for a humanoid robot based on optimal gradient method , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).