Motion Control of a Robotic Puppet through a Hybrid Motion Capture Device

In this paper we explore the motion control of a robotic puppet through motion capture data. A motion mapping technique is investigated to map the human motion into marionette motion, and from that calculate the rotation of the servo motors to achieve desired marionette motions. A software was developed to capture human motions utilizing a bend-twist sensor system, and use the motion data to control the robotic marionette by either offline control method or online control method (real-time). We also propose the idea of integrating human into the system to close the control loop. Experimental results show that our motion mapping enables puppet to follow the actor motions with good correspondence.

[1]  I-Ming Chen,et al.  Many strings attached: from conventional to robotic marionette manipulation , 2005, IEEE Robotics & Automation Magazine.

[2]  Hooshang Hemami,et al.  A marionette-based strategy for stable movement , 1993, IEEE Trans. Syst. Man Cybern..

[3]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[4]  Gernot Hoffmann.  Teach-in of a robot by showing the motion , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[5]  Lee A. Danisch,et al.  Spatially continuous six-degrees-of-freedom position and orientation sensor , 1999, Other Conferences.

[6]  Zhaoqin Peng,et al.  Capturing and analyzing of human motion for designing humanoid motion , 2005, 2005 IEEE International Conference on Information Acquisition.

[7]  I-Ming Chen,et al.  Design expressive behaviors for robotic puppet , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[8]  Minoru Asada,et al.  Automatic extraction of abstract actions from humanoid motion data , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  H. Benjamin Brown,et al.  Controlling a marionette with human motion capture data , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  Lee A. Danisch,et al.  Spatially continuous six degree of freedom position and orientation sensor , 1999 .