Skeleton-based motion capture for robust reconstruction of human motion

Optical motion capture provides an impressive ability to replicate gestures. However, even with a highly professional system there are many instances where crucial markers are occluded or when the algorithm confuses the trajectory of one marker with that of another. This requires much editing work on the part of the animator before the virtual characters are ready for their screen debuts. In this paper, we present an approach to increasing the robustness of a motion capture system by using a sophisticated anatomic human model. It includes a precise description of the skeleton's mobility and an approximated envelope. It allows us to accurately predict the 3-D location and visibility of markers, thus significantly increasing the robustness of marker tracking and assignment, and drastically reducing-or even eliminating-the need for human intervention during the 3D reconstruction process.

[1]  Daniel Thalmann,et al.  Human Motion Capture Driven by Orientation Measurements , 1999, Presence: Teleoperators & Virtual Environments.

[2]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[3]  Pascal Fua,et al.  Local and Global Skeleton Fitting Techniques for Optical Motion Capture , 1998, CAPTECH.

[4]  Olivier D. Faugeras,et al.  What can two images tell us about a third one? , 1994, ECCV.

[5]  D. Thalmann,et al.  Local and Global Skeleton Fitting Techniques for Optical Motion Capture , Modeling and Motion Capture Techniques for Virtual Environments , 1998 .

[6]  Pascal Fua,et al.  Modeling human bodies from video sequences , 1998, Electronic Imaging.

[7]  N. Malik,et al.  Particle tracking velocimetry in three-dimensional flows , 1993 .

[8]  Roberto Maiocchi,et al.  3-D character animation using motion capture , 1996 .

[9]  Daniel Thalmann,et al.  Interactive computer animation , 1996 .

[10]  Giancarlo Ferrigno,et al.  Elite: A Digital Dedicated Hardware System for Movement Analysis Via Real-Time TV Signal Processing , 1985, IEEE Transactions on Biomedical Engineering.

[11]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[12]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.

[13]  R. Plankers,et al.  Automated body modeling from video sequences , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.