A data-driven editing framework for automatic 3D garment modeling

Exploring shape variations on virtual garments is significant but challenging to the aspect of 3D garment modeling. In this paper, we propose a data-driven editing framework for automatic 3D garment modeling, which includes semantic garment segmentation, probabilistic reasoning for component suggestion, and garment component merging. The key idea in this work is to develop a simple but effective garment synthesis that utilizes a continuous style description, which can be characterized by the ratio of area and boundary length on garment components. First, a semi-supervised learning algorithm is proposed to simultaneously segment and label the components in 3D garments. Second, a set of matchable probability measurement is applied to recommend components that can be regarded as a new 3D garment. Third, a variation synthesis is developed to satisfy the garment style criteria while ensuring the realistic-looking plausibility of the results. As demonstrated by the experiments, our method is able to generate various reasonable garments with material effects to enrich existing 3D garments.

[1]  Martin Reimers,et al.  Mean value coordinates in 3D , 2005, Comput. Aided Geom. Des..

[2]  Xiaogang Jin,et al.  Creature grammar for creative modeling of 3D monsters , 2014, Graph. Model..

[3]  Daniel Cohen-Or,et al.  Active co-analysis of a set of shapes , 2012, ACM Trans. Graph..

[4]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[5]  Hans-Peter Seidel,et al.  Exploring Shape Variations by 3D‐Model Decomposition and Part‐based Recombination , 2012, Comput. Graph. Forum.

[6]  Lin Wang,et al.  Garment modeling with a depth camera , 2015, ACM Trans. Graph..

[7]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[8]  Daniel Cohen-Or,et al.  Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering , 2011, ACM Trans. Graph..

[9]  Ghassan Hamarneh,et al.  Prior Knowledge for Part Correspondence , 2011, Comput. Graph. Forum.

[10]  Alla Sheffer,et al.  Parameterization of Faceted Surfaces for Meshing using Angle-Based Flattening , 2001, Engineering with Computers.

[11]  Charlie C. L. Wang,et al.  Mesh fusion using functional blending on topologically incompatible sections , 2006, The Visual Computer.

[12]  Bruno Lévy.  Dual domain extrapolation , 2003, ACM Trans. Graph..

[13]  Charlie C. L. Wang,et al.  Feature based 3D garment design through 2D sketches , 2003, Comput. Aided Des..

[14]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Vladlen Koltun,et al.  Joint shape segmentation with linear programming , 2011, ACM Trans. Graph..

[16]  Fausto Bernardini,et al.  Cut-and-paste editing of multiresolution surfaces , 2002, SIGGRAPH.

[17]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[18]  Ariel Shamir,et al.  A survey on Mesh Segmentation Techniques , 2008, Comput. Graph. Forum.

[19]  Leonidas J. Guibas,et al.  Probabilistic reasoning for assembly-based 3D modeling , 2011, ACM Trans. Graph..

[20]  Nadia Magnenat-Thalmann.  Modeling and Simulating Bodies and Garments , 2010 .

[21]  Thomas A. Funkhouser,et al.  A benchmark for 3D mesh segmentation , 2009, ACM Trans. Graph..

[22]  Charlie C. L. Wang,et al.  Styling Evolution for Tight-Fitting Garments , 2016, IEEE Transactions on Visualization and Computer Graphics.

[23]  Yizhou Yu.  Laplacian Guided Editing, Synthesis, and Simulation , 2007 .

[24]  Siddhartha Chaudhuri,et al.  Data-driven suggestions for creativity support in 3D modeling , 2010, ACM Trans. Graph..

[25]  Alla Sheffer,et al.  Model Composition from Interchangeable Components , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[26]  John F. Hughes,et al.  A Sketch-Based Interface for Clothing Virtual Characters , 2007, IEEE Computer Graphics and Applications.

[27]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[28]  Charlie C. L. Wang,et al.  Mesh Composition on Models with Arbitrary Boundary Topology , 2008, IEEE Transactions on Visualization and Computer Graphics.

[29]  Hongbo Fu,et al.  Effective Derivation of Similarity Transformations for Implicit Laplacian Mesh Editing , 2007, Comput. Graph. Forum.

[30]  Tamy Boubekeur,et al.  GeoBrush: Interactive Mesh Geometry Cloning , 2011, Comput. Graph. Forum.

[31]  Antonio Torralba,et al.  Sharing Visual Features for Multiclass and Multiview Object Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Szymon Rusinkiewicz,et al.  Modeling by example , 2004, ACM Trans. Graph..

[33]  Nadia Magnenat-Thalmann,et al.  Accurate Garment Prototyping and Simulation , 2005 .

[34]  Charlie C. L. Wang,et al.  Flexible shape control for automatic resizing of apparel products , 2012, Comput. Aided Des..

[35]  Michael J. Black,et al.  The stitched puppet: A graphical model of 3D human shape and pose , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Leonidas J. Guibas,et al.  Exploration of continuous variability in collections of 3D shapes , 2011, ACM Trans. Graph..

[37]  Xiaogang Wang,et al.  Learning Semantic Signatures for 3D Object Retrieval , 2013, IEEE Transactions on Multimedia.

[38]  Susu Yao,et al.  A Mixed Reality Virtual Clothes Try-On System , 2013, IEEE Transactions on Multimedia.

[39]  Takeo Igarashi,et al.  Sensitive couture for interactive garment modeling and editing , 2011, ACM Trans. Graph..

[40]  Rongrong Ji,et al.  Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition , 2014, IEEE Transactions on Multimedia.

[41]  Eitan Grinspun,et al.  Parsing sewing patterns into 3D garments , 2013, ACM Trans. Graph..

[42]  Daniel Cohen-Or,et al.  Fit and diverse , 2012, ACM Trans. Graph..

[43]  Alla Sheffer,et al.  Design preserving garment transfer , 2012, ACM Trans. Graph..

[44]  Jituo Li,et al.  Modeling 3D garments by examples , 2014, Comput. Aided Des..

[45]  Changsheng Xu,et al.  Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Ji Wan,et al.  Deep Learning for Content-Based Image Retrieval: A Comprehensive Study , 2014, ACM Multimedia.

[47]  Derek Nowrouzezahrai,et al.  Multi‐objective shape segmentation and labeling , 2009, Comput. Graph. Forum.

[48]  Aaron Hertzmann,et al.  Learning 3D mesh segmentation and labeling , 2010, ACM Trans. Graph..

[49]  Thomas A. Funkhouser,et al.  Randomized cuts for 3D mesh analysis , 2008, SIGGRAPH Asia '08.

[50]  Lei Guo,et al.  Weakly Supervised Learning for Target Detection in Remote Sensing Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[51]  Xiaogang Jin,et al.  Computer aided clothing pattern design with 3D editing and pattern alteration , 2012, Comput. Aided Des..

[52]  Siddhartha Chaudhuri,et al.  A probabilistic model for component-based shape synthesis , 2012, ACM Trans. Graph..

[53]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Xinlei Chen,et al.  Semi‐supervised Mesh Segmentation and Labeling , 2012, Comput. Graph. Forum.

[55]  Alla Sheffer,et al.  Context-aware garment modeling from sketches , 2011, Comput. Graph..

[56]  Tao Ju,et al.  Mean value coordinates for closed triangular meshes , 2005, ACM Trans. Graph..

[57]  Daniel Cohen-Or,et al.  SnapPaste: an interactive technique for easy mesh composition , 2006, The Visual Computer.

[58]  Christian Rössl,et al.  Laplacian surface editing , 2004, SGP '04.

[59]  Zeev Farbman,et al.  Coordinates for instant image cloning , 2009, ACM Trans. Graph..