Estimating body shape of dressed humans

The paper presents a method to estimate the detailed 3D body shape of a person even if heavy or loose clothing is worn. The approach is based on a space of human shapes, learned from a large database of registered body scans. Together with this database we use as input a 3D scan or model of the person wearing clothes and apply a fitting method, based on ICP (iterated closest point) registration and Laplacian mesh deformation. The statistical model of human body shapes enforces that the model stays within the space of human shapes. The method therefore allows us to compute the most likely shape and pose of the subject, even if it is heavily occluded or body parts are not visible. Several experiments demonstrate the applicability and accuracy of our approach to recover occluded or missing body parts from 3D laser scans.

[1]  Adrian Hilton,et al.  Surface Capture for Performance-Based Animation , 2007, IEEE Computer Graphics and Applications.

[2]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[3]  Hans-Peter Seidel,et al.  Reverse Engineering Garments , 2007, MIRAGE.

[4]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[5]  Hans-Peter Seidel,et al.  A system for articulated tracking incorporating a clothing model , 2007, Machine Vision and Applications.

[6]  Sami Romdhani,et al.  Optimal Step Nonrigid ICP Algorithms for Surface Registration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[8]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, SIGGRAPH 2008.

[9]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[10]  Olga Sorkine-Hornung,et al.  Context‐Aware Skeletal Shape Deformation , 2007, Comput. Graph. Forum.

[11]  Michael J. Black,et al.  The Naked Truth: Estimating Body Shape Under Clothing , 2008, ECCV.

[12]  Marc Alexa,et al.  Differential coordinates for local mesh morphing and deformation , 2003, The Visual Computer.

[13]  D. Levin,et al.  Linear rotation-invariant coordinates for meshes , 2005, SIGGRAPH 2005.

[14]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[15]  Michael J. Black,et al.  Detailed Human Shape and Pose from Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  G. Murphy.  C*-Algebras and Operator Theory , 1990 .

[17]  Michael Garland,et al.  Free-form motion processing , 2008, TOGS.

[18]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[19]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[20]  Wojciech Matusik,et al.  Articulated mesh animation from multi-view silhouettes , 2008, ACM Trans. Graph..

[21]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[22]  Hans-Peter Seidel,et al.  Performance capture from sparse multi-view video , 2008, ACM Trans. Graph..

[23]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[24]  Daniel Cohen-Or,et al.  Linear rotation-invariant coordinates for meshes , 2005, ACM Trans. Graph..