A Data-driven Approach to Human-body Cloning Using a Segmented Body Database

We present a data-driven approach to build a human body model from a single photograph by performing Principal Component Analysis (PCA) on a database of body segments. We segment a collection of human bodies to compile the required database prior to performing the analysis. Our approach then builds a single PCA for each body segment - head, left and right arms, torso and left and right legs - yielding six PCAs in total. This strategy improves on the flexibility of conventional data-driven approaches in 3D modeling and allows our approach to take variations in ethnicity, age and body posture into account. We demonstrate our approach in practice by constructing models of a Caucasian male, an Asian male and a toddler from corresponding photographs and a Caucasian adult oriented database. We also discuss rapid consistent parameterization based on Radial Basis Functions (RBF) and non-optimization based learning systems to reduce execution time.

[1]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[2]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[3]  A. Jacobson,et al.  Morphometric tools for landmark data , 1993 .

[4]  KwangYun Wohn,et al.  3D Body Reconstruction from Photos Based on Range Scan , 2006, Edutainment.

[5]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[6]  Won-Sook Lee,et al.  Analysis of segmented human body scans , 2007, GI '07.

[7]  Tae-Kyun Kim,et al.  Component-based LDA Face Descriptor for Image Retrieval , 2002, BMVC.

[8]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[9]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[10]  Nadia Magnenat-Thalmann,et al.  An automatic modeling of human bodies from sizing parameters , 2003, I3D '03.

[11]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[12]  Jun-yong Noh,et al.  Expression cloning , 2001, SIGGRAPH.

[13]  Steve Marschner,et al.  Modeling and Rendering for Realistic Facial Animation , 2000, Rendering Techniques.

[14]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[15]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[16]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[17]  Won-Sook Lee Eyematic.  Making One Structured Body , 2002 .

[18]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..

[19]  Thomas Vetter,et al.  Estimating Coloured 3D Face Models from Single Images: An Example Based Approach , 1998, ECCV.

[20]  Peter Schröder,et al.  Consistent mesh parameterizations , 2001, SIGGRAPH.

[21]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[22]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.