Parametric 3D modeling of a symmetric human body

Abstract To realistically represent 3D human body shape in a mathematical way, the parametric model used should incorporate symmetry as displayed by real people. This paper proposes a symmetric parametric model called symmetricSCAPE. It successfully incorporates symmetry into a parametric model of the 3D body, formulating body geometric variations of both shape and pose using a triangular mesh representation. The symmetry constraint is imposed on each symmetrically-related triangle pair of the body mesh. Mathematically, symmetry-related constraint matrices are derived, and applied during shape and pose deformation of triangle pairs. By accurately registering a pre-designed symmetrization template mesh to the training dataset, we learn how the symmetricSCAPE model causes the body mesh to deform relative to the symmetry. Our experiments demonstrate that the symmetricSCAPE model results in a better, more parsimonious, and more accurate parametric model of the 3D human body than traditional non-symmetry-aware representations.

[1]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[2]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[3]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[4]  Michael J. Black,et al.  Breathing life into shape , 2014, ACM Trans. Graph..

[5]  Qionghai Dai,et al.  DoubleFusion: Real-Time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Vladimir G. Kim,et al.  Möbius Transformations For Global Intrinsic Symmetry Analysis , 2010, Comput. Graph. Forum.

[7]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[8]  Nadia Magnenat-Thalmann,et al.  An automatic modeling of human bodies from sizing parameters , 2003, I3D '03.

[9]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[10]  Bodo Rosenhahn,et al.  Sparse Inertial Poser: Automatic 3D Human Pose Estimation from Sparse IMUs , 2017, Comput. Graph. Forum.

[11]  Michael J. Black,et al.  Dynamic FAUST: Registering Human Bodies in Motion , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Yaser Sheikh,et al.  Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Huamin Wang,et al.  Real-time Human Pose and Shape Estimation for Virtual Try-On Using a Single Commodity Depth Camera , 2014, IEEE Trans. Vis. Comput. Graph..

[14]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[15]  Ralph R. Martin,et al.  Realtime Reconstruction of an Animating Human Body from a Single Depth Camera , 2016, IEEE Transactions on Visualization and Computer Graphics.

[16]  Michael J. Black,et al.  Dyna: a model of dynamic human shape in motion , 2015, ACM Trans. Graph..

[17]  Ligang Liu,et al.  Partial intrinsic reflectional symmetry of 3D shapes , 2009, ACM Trans. Graph..

[18]  Kathleen M. Robinette,et al.  The CAESAR project: a 3-D surface anthropometry survey , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[19]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[20]  Meekyoung Kim,et al.  Data-driven physics for human soft tissue animation , 2017, ACM Trans. Graph..

[21]  Leonidas J. Guibas,et al.  Global Intrinsic Symmetries of Shapes , 2008, Comput. Graph. Forum.

[22]  Michael J. Black,et al.  Coregistration: Simultaneous Alignment and Modeling of Articulated 3D Shape , 2012, ECCV.

[23]  Zicheng Liu,et al.  Tensor-Based Human Body Modeling , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Michael J. Black,et al.  ClothCap , 2017, ACM Trans. Graph..

[25]  Michael J. Black,et al.  Detailed Full-Body Reconstructions of Moving People from Monocular RGB-D Sequences , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[26]  Michael J. Black,et al.  3D Menagerie: Modeling the 3D Shape and Pose of Animals , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).