Physically Valid Shape Parameterization for Monocular 3-D Deformable Surface Tracking

We develop a low-dimensional approximation of the set of possible deformations of smoothly deforming objects of planar topology. To this end, we propose a novel parameterization of inextensible surfaces that allows us first to effectively sample the space of all possible deformations, which is a priori very large, and then to derive the low-dimensional model using a simple dimensionality reduction technique. We incorporate the resulting models into a monocular tracking system that we use to capture complex deformations of objects such as sheets of paper or more flexible material. We also show that, even though the model was built by sampling the set of possible deformations of inextensible surfaces, it can also handle extensible ones.

[1]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[2]  Ronald Fedkiw,et al.  Invertible finite elements for robust simulation of large deformation , 2004, SCA '04.

[3]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Dimitris N. Metaxas,et al.  Constrained deformable superquadrics and nonrigid motion tracking , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Hervé Delingette,et al.  Real-Time Large Displacement Elasticity for Surgery Simulation: Non-linear Tensor-Mass Model , 2000, MICCAI.

[6]  Alex Pentland,et al.  Automatic extraction of deformable part models , 1990, International Journal of Computer Vision.

[7]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[8]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[9]  Tomaso A. Poggio,et al.  Reanimating Faces in Images and Video , 2003, Comput. Graph. Forum.

[10]  Adrien Bartoli,et al.  Direct Estimation of Non-Rigid Registration , 2004, BMVC.

[11]  Demetri Terzopoulos,et al.  A dynamic finite element surface model for segmentation and tracking in multidimensional medical images with application to cardiac 4D image analysis. , 1995, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[12]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Laurent D. Cohen,et al.  Deformable models for 3-D medical images using finite elements and balloons , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Dmitry B. Goldgof,et al.  Efficient Nonlinear Finite Element Modeling of Nonrigid Objects via Optimization of Mesh Models , 1998, Comput. Vis. Image Underst..

[15]  Katsushi Ikeuchi,et al.  Deformable surfaces: a free-form shape representation , 1991, Optics & Photonics.