The space of human body shapes: reconstruction and parameterization from range scans

We develop a novel method for fitting high-resolution template meshes to detailed human body range scans with sparse 3D markers. We formulate an optimization problem in which the degrees of freedom are an affine transformation at each template vertex. The objective function is a weighted combination of three measures: proximity of transformed vertices to the range data, similarity between neighboring transformations, and proximity of sparse markers at corresponding locations on the template and target surface. We solve for the transformations with a non-linear optimizer, run at two resolutions to speed convergence. We demonstrate reconstruction and consistent parameterization of 250 human body models. With this parameterized set, we explore a variety of applications for human body modeling, including: morphing, texture transfer, statistical analysis of shape, model fitting from sparse markers, feature analysis to modify multiple correlated parameters (such as the weight and height of an individual), and transfer of surface detail and animation controls from a template to fitted models.

[1]  S. S. Stevens,et al.  The varieties of human physique. , 1940 .

[2]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[3]  Jacques Feldmar,et al.  Rigid and Affine Registration of Smooth Surfaces using Differential Properties , 1994, ECCV.

[4]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[5]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[6]  David P. Dobkin,et al.  MAPS: multiresolution adaptive parameterization of surfaces , 1998, SIGGRAPH.

[7]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[8]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[9]  Hugues Hoppe,et al.  Displaced subdivision surfaces , 2000, SIGGRAPH.

[10]  Steve Marschner,et al.  Modeling and Rendering for Realistic Facial Animation , 2000, Rendering Techniques.

[11]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[12]  Peter Schröder,et al.  Consistent mesh parameterizations , 2001, SIGGRAPH.

[13]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[14]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[15]  Adrian Hilton,et al.  From 3D shape capture of animated models , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[16]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[17]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[18]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[19]  Ross T. Whitaker,et al.  A Level-Set Approach to 3D Reconstruction from Range Data , 1998, International Journal of Computer Vision.

[20]  Richard Szeliski,et al.  Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines , 1993, Proceedings of IEEE Workshop on Biomedical Image Analysis.