Scanning and animating characters dressed in multiple-layer garments

Despite the development of user-friendly interfaces for modeling garments and putting them onto characters, preparing a character dressed in multiple layers of garments can be very time-consuming and tedious. In this paper, we propose a novel scanning-based solution for modeling and animating characters wearing multiple layers of clothes. This is achieved by making use of real clothes and human bodies. We first scan the naked body of a subject by an RGBD camera, and a statistical body model is fit to the scanned data. This results in a skinned articulated model of the subject. The subject is then asked to put on one piece of garment after another, and the articulated body model dressed up to the previous step is fit to the newly scanned data. The new garment is segmented in a semi-automatic fashion and added as an additional layer to the multi-layer garment model. During runtime, the skinned character is controlled based on the motion capture data and the multi-layer garment model is controlled by blending the movements computed by physical simulation and linear blend skinning, such that the cloth preserves its shape while it shows realistic physical motion. We present results where the character is wearing multiple layers of garments including a shirt, coat and a skirt. Our framework can be useful for preparing and animating dressed characters for computer games and films.

[1]  Nadia Magnenat-Thalmann,et al.  Generating unified model for dressed virtual humans , 2005, The Visual Computer.

[2]  Pieter Peers,et al.  Dynamic shape capture using multi-view photometric stereo , 2009, ACM Trans. Graph..

[3]  Nadia Magnenat-Thalmann,et al.  Made-to-Measure Technologies for an Online Clothing Store , 2003, IEEE Computer Graphics and Applications.

[4]  C. Karen Liu,et al.  Animating human dressing , 2015, ACM Trans. Graph..

[5]  Nadia Magnenat-Thalmann,et al.  Real‐time Animation of Dressed Virtual Humans , 2002, Comput. Graph. Forum.

[6]  Taku Komura,et al.  Character Motion Synthesis by Topology Coordinates , 2009, Comput. Graph. Forum.

[7]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[8]  Ari Shapiro,et al.  Avatar reshaping and automatic rigging using a deformable model , 2015, MIG.

[9]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[10]  Sebastian Thrun,et al.  Video-based reconstruction of animatable human characters , 2010, ACM Trans. Graph..

[11]  Paolo Cignoni,et al.  A low cost 3D scanner based on structured light , 2001 .

[12]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[13]  Tao Ju,et al.  Mean value coordinates for closed triangular meshes , 2005, ACM Trans. Graph..

[14]  WangHuamin A chebyshev semi-iterative approach for accelerating projective and position-based dynamics , 2015 .

[15]  Olga Sorkine-Hornung,et al.  Instant field-aligned meshes , 2015, ACM Trans. Graph..

[16]  Cynthia L. Istook,et al.  3D body scanning systems with application to the apparel industry , 2001 .

[17]  Jovan Popovic,et al.  Automatic rigging and animation of 3D characters , 2007, ACM Trans. Graph..

[18]  Mark Pauly,et al.  Projective dynamics , 2014, ACM Trans. Graph..

[19]  Andrea Tagliasacchi,et al.  Robust Articulated-ICP for Real-Time Hand Tracking , 2015 .

[20]  Petros Daras,et al.  Real-Time, Full 3-D Reconstruction of Moving Foreground Objects From Multiple Consumer Depth Cameras , 2013, IEEE Transactions on Multimedia.

[21]  M. Mochimaru,et al.  Markerless landmark localization on body shape scans by non-rigid model fitting , 2013 .

[22]  Christian Theobalt,et al.  On-set performance capture of multiple actors with a stereo camera , 2013, ACM Trans. Graph..

[23]  Zhengyou Zhang,et al.  Microsoft Kinect Sensor and Its Effect , 2012, IEEE Multim..

[24]  Ling Lin,et al.  Topology-independent 3D garment fitting for virtual clothing , 2015, Multimedia Tools and Applications.

[25]  Alla Sheffer,et al.  Author manuscript, published in "ACM Transactions on Graphics (2012)" DOI: 10.1145/2185520.2185532 Design Preserving Garment Transfer , 2012 .

[26]  Taku Komura,et al.  Harmonic parameterization by electrostatics , 2013, TOGS.

[27]  Ming Zeng,et al.  Templateless Quasi-rigid Shape Modeling with Implicit Loop-Closure , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Takeo Igarashi,et al.  Clothing manipulation , 2003, ACM Trans. Graph..

[29]  Nobuyuki Umetani,et al.  Sensitivity-optimized rigging for example-based real-time clothing synthesis , 2014, ACM Trans. Graph..

[30]  Dinesh Manocha,et al.  CAMA: Contact‐Aware Matrix Assembly with Unified Collision Handling for GPU‐based Cloth Simulation , 2016, Comput. Graph. Forum.

[31]  Takeo Igarashi,et al.  Sensitive couture for interactive garment modeling and editing , 2011, SIGGRAPH 2011.

[32]  Huamin Wang,et al.  A chebyshev semi-iterative approach for accelerating projective and position-based dynamics , 2015, ACM Trans. Graph..

[33]  Didier Stricker,et al.  KinectAvatar: Fully Automatic Body Capture Using a Single Kinect , 2012, ACCV Workshops.