SCAPE: shape completion and animation of people

We introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both articulated and non-rigid deformations. We learn a pose deformation model that derives the non-rigid surface deformation as a function of the pose of the articulated skeleton. We also learn a separate model of variation based on body shape. Our two models can be combined to produce 3D surface models with realistic muscle deformation for different people in different poses, when neither appear in the training set. We show how the model can be used for shape completion --- generating a complete surface mesh given a limited set of markers specifying the target shape. We present applications of shape completion to partial view completion and motion capture animation. In particular, our method is capable of constructing a high-quality animated surface model of a moving person, with realistic muscle deformation, using just a single static scan and a marker motion capture sequence of the person.

[1]  Demetri Terzopoulos,et al.  Multilinear Analysis of Image Ensembles: TensorFaces , 2002, ECCV.

[2]  Takeo Kanade,et al.  Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[4]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[5]  Sebastian Thrun,et al.  The Correlated Correspondence Algorithm for Unsupervised Registration of Nonrigid Surfaces , 2004, NIPS.

[6]  Adrian Hilton,et al.  From 3D shape capture of animated models , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[7]  S. Thrun,et al.  An Extension of the ICP Algorithm for Modeling Nonrigid Objects with Mobile Robots , 2003, IJCAI.

[8]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[9]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[10]  Richard Szeliski,et al.  Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines , 1993, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[11]  Nadia Magnenat-Thalmann,et al.  An automatic modeling of human bodies from sizing parameters , 2003, I3D '03.

[12]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[13]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[14]  Sebastian Thrun,et al.  Recovering Articulated Object Models from 3D Range Data , 2004, UAI.

[15]  Jovan Popović,et al.  Deformation transfer for triangle meshes , 2004, SIGGRAPH 2004.

[16]  Hanspeter Pfister,et al.  Multilinear models for face synthesis , 2004, SIGGRAPH '04.

[17]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[18]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[19]  Jun-yong Noh,et al.  Expression cloning , 2001, SIGGRAPH 2001.

[20]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[21]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[22]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[23]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[24]  Willett,et al.  TIGER : Interrogation d'une table relationnelle par extension de critères , 2010 .

[25]  Jovan Popovic,et al.  Continuous capture of skin deformation , 2003, ACM Trans. Graph..