A system for articulated tracking incorporating a clothing model

In this paper an approach for motion capture of dressed people is presented. A cloth draping method is incorporated in a silhouette based motion capture system. This leads to a simultaneous estimation of pose, joint angles, cloth draping parameters and wind forces. An error functional is formalized to minimize the involved parameters simultaneously. This allows for reconstruction of the underlying kinematic structure, even though it is covered with fabrics. Finally, a quantitative error analysis is performed. Pose results are compared with results obtained from a commercially available marker based tracking system. The deviations have a magnitude of three degrees which indicates a reasonably stable approach.

[1]  R. Rautmann.  Approximation Methods for Navier-Stokes Problems , 1980 .

[2]  A. Dervieux,et al.  A finite element method for the simulation of a Rayleigh-Taylor instability , 1980 .

[3]  Jerry Weil,et al.  The synthesis of cloth objects , 1986, SIGGRAPH.

[4]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[5]  Olivier Faugeras,et al.  Proceedings of the first european conference on Computer vision , 1990, eccv 1990.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Laura Hoch.  Computer Analysis of Images and Patterns , 1993, Lecture Notes in Computer Science.

[8]  V. Caselles,et al.  A geometric model for active contours in image processing , 1993 .

[9]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[10]  David E. Breen,et al.  Towards simulating cloth dynamics using interacting particles , 1996 .

[11]  Andrew E. Johnson,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[12]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[13]  J. Richards,et al.  The measurement of human motion: A comparison of commercially available systems , 1999 .

[14]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[15]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[16]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[17]  Pascal Fua,et al.  Tracking and Modeling People in Video Sequences , 2001, Comput. Vis. Image Underst..

[18]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[19]  Wolfgang Heidrich,et al.  Cloth Motion Capture , 2003, SIGGRAPH '03.

[20]  Hans-Peter Seidel,et al.  Free-viewpoint video of human actors , 2003, ACM Trans. Graph..

[21]  Bodo Rosenhahn,et al.  Pose estimation revisited , 2006 .

[22]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[23]  J. Sethian,et al.  FRONTS PROPAGATING WITH CURVATURE DEPENDENT SPEED: ALGORITHMS BASED ON HAMILTON-JACOB1 FORMULATIONS , 2003 .

[24]  Rachid Deriche,et al.  Unsupervised Segmentation Incorporating Colour, Texture, and Motion , 2003, CAIP.

[25]  Lihua You,et al.  Fast generation of 3-D deformable moving surfaces , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[26]  Mohan M. Trivedi,et al.  Human Body Model Acquisition and Tracking Using Voxel Data , 2003, International Journal of Computer Vision.

[27]  Jitendra Malik,et al.  Twist Based Acquisition and Tracking of Animal and Human Kinematics , 2004, International Journal of Computer Vision.

[28]  Pascal Fua,et al.  Hierarchical Implicit Surface Joint Limits to Constrain Video-Based Motion Capture , 2004, ECCV.

[29]  Bodo Rosenhahn,et al.  Pose Estimation of Free-Form Objects , 2004, ECCV.

[30]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking , 2005, International Journal of Computer Vision.

[31]  André Gagalowicz,et al.  Determination of Fabric Viscosity Parameters Using Iterative Minimization , 2005, CAIP.

[32]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[33]  Nadia Magnenat-Thalmann,et al.  From early draping to haute couture models: 20 years of research , 2005, The Visual Computer.

[34]  Pavel Krsek,et al.  Robust Euclidean alignment of 3D point sets: the trimmed iterative closest point algorithm , 2005, Image Vis. Comput..

[35]  Bodo Rosenhahn,et al.  A System for Marker-Less Human Motion Estimation , 2005, DAGM-Symposium.

[36]  Bodo Rosenhahn,et al.  Nonparametric Density Estimation for Human Pose Tracking , 2006, DAGM-Symposium.

[37]  Nadia Magnenat-Thalmann,et al.  Automatic modeling of virtual humans and body clothing , 2004, Journal of Computer Science and Technology.