Controlling a marionette with human motion capture data

In this paper, we present a method for controlling a motorized, string-driven marionette using motion capture data from human actors. The motion data must be adapted for the marionette because its kinematic and dynamic properties differ from those of the human actor in degrees of freedom, limb length, workspace, mass distribution, sensors, and actuators. This adaptation is accomplished via an inverse kinematics algorithm that takes into account marker positions, joint motion ranges, string constraints, and potential energy. We also apply a feedforward controller to prevent extraneous swings of the hands. Experimental results show that our approach enables the marionette to perform motions that are qualitatively similar to the original human motion capture data.

[1]  Yoshihiko Nakamura,et al.  Inverse kinematic solutions with singularity robustness for robot manipulator control , 1986 .

[2]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[3]  A. A. Maciejewsk Dealing with the Ill-Conditioned Epuations of Motion for Articulated Figures , 1990 .

[4]  Anthony A. Maciejewski,et al.  Dealing with the ill-conditioned equations of motion for articulated figures , 1990, IEEE Computer Graphics and Applications.

[5]  Gernot Hoffmann Teach-in of a robot by showing the motion , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[6]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[7]  Darren M. Dawson,et al.  Asymptotically Stabilizing Angle Feedback for a Flexible Cable Gantry Crane , 1999 .

[8]  Hyeong-Seok Ko,et al.  Motion Balance Filtering , 2000, Comput. Graph. Forum.

[9]  Y. Kuroki,et al.  A small biped entertainment robot , 2001, MHS2001. Proceedings of 2001 International Symposium on Micromechatronics and Human Science (Cat. No.01TH8583).

[10]  Hirochika Inoue,et al.  Real-time humanoid motion generation through ZMP manipulation based on inverted pendulum control , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Katsu Yamane,et al.  Synergetic CG choreography through constraining and deconstraining at will , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[13]  Katsu Yamane,et al.  Dynamics Filter - concept and implementation of online motion Generator for human figures , 2000, IEEE Trans. Robotics Autom..