Capture and Stylization of Human Models

Capturing and creating models of human subjects is an ongoing effort in computer graphics. In this paper, we present a framework to capture, model, simplify, and stylize an human subject. We use a consumer 3D depth camera that captures the appearance, shape, and pose of the recorded person. We then fit this data with a parametric human model that is based on 3D scans available from the CAESAR database. Once we have a personalized 3D human model, we can apply stylization techniques to create a variety of outputs. We present several results obtained with our framework and verify that these models remain recognizable as their human sources.

[1]  Niloy J. Mitra,et al.  Abstraction of man-made shapes , 2009, SIGGRAPH 2009.

[2]  Yi Liu,et al.  Cartoon-like stylization of video for real-time applications , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[3]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[4]  Nadia Magnenat-Thalmann,et al.  An example-based approach to human body manipulation , 2004, Graph. Model..

[5]  Jinxiang Chai,et al.  VideoMocap: modeling physically realistic human motion from monocular video sequences , 2010, ACM Trans. Graph..

[6]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[7]  R. Fletcher Practical Methods of Optimization , 1988 .

[8]  Michael J. Black,et al.  Estimating human shape and pose from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[10]  Adrian Hilton,et al.  A Validated Method for Dense Non-rigid 3D Face Registration , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[11]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, ACM Trans. Graph..

[12]  D. Cohen-Or,et al.  Parametric reshaping of human bodies in images , 2010, ACM Trans. Graph..

[13]  Harry Shum,et al.  Video tooning , 2004, ACM Trans. Graph..

[14]  Aaron Hertzmann,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2006) Learning a Correlated Model of Identity and Pose-dependent Body Shape Variation for Real-time Synthesis , 2022 .

[15]  Douglas DeCarlo,et al.  Stylization and abstraction of photographs , 2002, ACM Trans. Graph..

[16]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[17]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH 2005.

[18]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Erik Reinhard,et al.  Human facial illustrations: Creation and psychophysical evaluation , 2004, TOGS.

[20]  J. Warren,et al.  Mean value coordinates for closed triangular meshes , 2005, SIGGRAPH 2005.

[21]  Hans-Peter Seidel,et al.  A Statistical Model of Human Pose and Body Shape , 2009, Comput. Graph. Forum.

[22]  J. Nocedal,et al.  A Limited Memory Algorithm for Bound Constrained Optimization , 1995, SIAM J. Sci. Comput..

[23]  Sebastian Thrun,et al.  Real time motion capture using a single time-of-flight camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Hans-Peter Seidel,et al.  Multilinear pose and body shape estimation of dressed subjects from image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.