Building statistical shape spaces for 3D human modeling

Expressive 3D human shape models are proposed.The models are learned from the largest available dataset of laser scans.Various template fitting and posture normalization approaches are evaluated.High quality of the learned shape spaces is empirically demonstrated.Proposed models and code to data pre-processing and model fitting are released. Statistical models of 3D human shape and pose learned from scan databases have developed into valuable tools to solve a variety of vision and graphics problems. Unfortunately, most publicly available models are of limited expressiveness as they were learned on very small databases that hardly reflect the true variety in human body shapes. In this paper, we contribute by rebuilding a widely used statistical body representation from the largest commercially available scan database, and making the resulting model available to the community (visit http://humanshape.mpi-inf.mpg.de). As preprocessing several thousand scans for learning the model is a challenge in itself, we contribute by developing robust best practice solutions for scan alignment that quantitatively lead to the best learned models. We make implementations of these preprocessing steps also publicly available. We extensively evaluate the improved accuracy and generality of our new model, and show its improved performance for human body reconstruction from sparse input data.

[1]  Hans-Peter Seidel,et al.  Estimating body shape of dressed humans , 2009, Comput. Graph..

[2]  Aaron Hertzmann,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Learning a Correlated Model of Identity and Pose-dependent Body Shape Variation for Real-time Synthesis , 2022 .

[3]  Stefano Corazza,et al.  Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  LeeKunwoo,et al.  Parametric human body shape modeling framework for human-centered product design , 2012 .

[5]  Michael J. Black,et al.  Breathing life into shape , 2014, ACM Trans. Graph..

[6]  Michael J. Black,et al.  Estimating human shape and pose from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[7]  Michael J. Black,et al.  Home 3D body scans from noisy image and range data , 2011, 2011 International Conference on Computer Vision.

[8]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, ACM Trans. Graph..

[9]  Chang Shu,et al.  Estimating 3D human shapes from measurements , 2012, Machine Vision and Applications.

[10]  Adrian Hilton,et al.  Shape and Pose Space Deformation for Subject Specific Animation , 2013, 2013 International Conference on 3D Vision.

[11]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[12]  KwangYun Wohn,et al.  3D Body Reconstruction from Photos Based on Range Scan , 2006, Edutainment.

[13]  Slobodan Ilic,et al.  3D Semantic Parameterization for Human Shape Modeling: Application to 3D Animation , 2013, 2013 International Conference on 3D Vision.

[14]  BruntonAlan,et al.  Estimation of human body shape and posture under clothing , 2014 .

[15]  Michael J. Black,et al.  Dyna: a model of dynamic human shape in motion , 2015, ACM Trans. Graph..

[16]  Kathleen M. Robinette,et al.  The CAESAR project: a 3-D surface anthropometry survey , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[17]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[18]  Bernt Schiele,et al.  In Good Shape: Robust People Detection based on Appearance and Shape , 2011, BMVC.

[19]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[20]  Kunwoo Lee,et al.  Parametric human body shape modeling framework for human-centered product design , 2012, Comput. Aided Des..

[21]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[22]  D. Cohen-Or,et al.  Parametric reshaping of human bodies in images , 2010, ACM Trans. Graph..

[23]  Jochen Lang,et al.  Estimation of human body shape and posture under clothing , 2013, Comput. Vis. Image Underst..

[24]  Chang Shu,et al.  Posture-invariant statistical shape analysis using Laplace operator , 2012, Comput. Graph..

[25]  Nadia Magnenat-Thalmann,et al.  An automatic modeling of human bodies from sizing parameters , 2003, I3D '03.

[26]  Michael J. Black,et al.  Combined discriminative and generative articulated pose and non-rigid shape estimation , 2007, NIPS.

[27]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[28]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Bernt Schiele,et al.  Articulated people detection and pose estimation: Reshaping the future , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Michael J. Black,et al.  FAUST: Dataset and Evaluation for 3D Mesh Registration , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Chang Shu,et al.  Three-dimensional human shape inference from silhouettes: reconstruction and validation , 2011, Machine Vision and Applications.

[32]  Martin Styner,et al.  Evaluation of 3D Correspondence Methods for Model Building , 2003, IPMI.

[33]  Charlie C. L. Wang,et al.  Exemplar-based statistical model for semantic parametric design of human body , 2010, Comput. Ind..

[34]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .

[35]  Chang Shu,et al.  Landmark-free posture invariant human shape correspondence , 2011, The Visual Computer.

[36]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[37]  Hans-Peter Seidel,et al.  Multilinear pose and body shape estimation of dressed subjects from image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Gary K. L. Tam,et al.  Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid , 2013, IEEE Transactions on Visualization and Computer Graphics.

[39]  Ghassan Hamarneh,et al.  A Survey on Shape Correspondence , 2011, Comput. Graph. Forum.

[40]  Zicheng Liu,et al.  Tensor-Based Human Body Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Marcus A. Magnor,et al.  Capture and Statistical Modeling of Arm‐Muscle Deformations , 2013, Comput. Graph. Forum.

[42]  Won-Sook Lee,et al.  A Data-driven Approach to Human-body Cloning Using a Segmented Body Database , 2007 .

[43]  Michael J. Black,et al.  The Naked Truth: Estimating Body Shape Under Clothing , 2008, ECCV.

[44]  Michael J. Black,et al.  DRAPE , 2012, ACM Trans. Graph..

[45]  Hans-Peter Seidel,et al.  Personalization and Evaluation of a Real-Time Depth-Based Full Body Tracker , 2013, 2013 International Conference on 3D Vision.

[46]  Won-Sook Lee,et al.  A Data-driven Approach to Human-body Cloning Using a Segmented Body Database , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).