Software and Methods for Motion Capture and Tracking in Animation

This extended abstract details previous methods for motion tracking and capture in 3D animation and in particular that of hand motion tracking and capture. Our research aims to enable gesture capture with interpretation of the captured gestures and control of the target 3D animation software. This stage of the project involves the development and testing of a motion analysis system. A motion analysis system is being built from algorithms recently developed. We review current software and research methods available in this area and describe our work-inprogress. Motion capture is a technique of digitally recording the movements of real entities, usually humans. It was originally developed as an analysis tool in biomechanics research, but has grown increasingly important as a source of motion data for computer animation. In this context it has been widely used for both cinema and video games. Hand motion capture and tracking in particular has received a lot of attention because of its critical role in the design of new Human Computer Interaction methods and gesture analysis. One of the main difficulties is the capture of human hand motion.

[1]  Frank P. Ferrie,et al.  Monocular optical flow for real-time vision systems , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[2]  Sung Uk Lee,et al.  3D hand reconstruction from a monocular view , 2004, ICPR 2004.

[3]  Philip J. Morrow,et al.  Adaptive Grid Refinement Procedures for Efficient Optical Flow Computation , 2004, International Journal of Computer Vision.

[4]  Björn Stenger,et al.  Model-based hand tracking using a hierarchical Bayesian filter , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  David C. Hogg,et al.  Towards 3D hand tracking using a deformable model , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Mathias Kölsch,et al.  Hand Tracking with Flocks of Features , 2005, CVPR.

[8]  Jing Xiao,et al.  Multi-view AAM fitting and camera calibration , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Ying Wu,et al.  Capturing human hand motion in image sequences , 2002, Workshop on Motion and Video Computing, 2002. Proceedings..

[10]  Sung Uk Lee,et al.  3D hand reconstruction from a monocular view , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Radu Horaud,et al.  Hand Motion from 3D Point Trajectories and a Smooth Surface Model , 2004, ECCV.

[12]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[13]  Shan Lu,et al.  Using multiple cues for hand tracking and model refinement , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Thomas S. Huang,et al.  Tracking articulated hand motion with eigen dynamics analysis , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Stan Sclaroff,et al.  Estimating 3D hand pose from a cluttered image , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..