Learning a shared shape space for multimodal garment design

Designing real and virtual garments is becoming extremely demanding with rapidly changing fashion trends and increasing need for synthesizing realisticly dressed digital humans for various applications. This necessitates creating simple and effective workflows to facilitate authoring sewing patterns customized to garment and target body shapes to achieve desired looks. Traditional workflow involves a trial-and-error procedure wherein a mannequin is draped to judge the resultant folds and the sewing pattern iteratively adjusted until the desired look is achieved. This requires time and experience. Instead, we present a data-driven approach wherein the user directly indicates desired fold patterns simply by sketching while our system estimates corresponding garment and body shape parameters at interactive rates. The recovered parameters can then be further edited and the updated draped garment previewed. Technically, we achieve this via a novel shared shape space that allows the user to seamlessly specify desired characteristics across multimodal input without requiring to run garment simulation at design time. We evaluate our approach qualitatively via a user study and quantitatively against test datasets, and demonstrate how our system can generate a rich quality of on-body garments targeted for a range of body shapes while achieving desired fold characteristics. Code and data are available at our project webpage.

[1]  Wolfgang Heidrich,et al.  Cloth Motion Capture , 2003, SIGGRAPH '03.

[2]  James F. O'Brien,et al.  Example-based wrinkle synthesis for clothing animation , 2010, ACM Trans. Graph..

[3]  Derek Bradley,et al.  Markerless garment capture , 2008, SIGGRAPH 2008.

[4]  Markus H. Gross,et al.  DeepGarment : 3D Garment Shape Estimation from a Single Image , 2017, Comput. Graph. Forum.

[5]  John F. Hughes,et al.  Sketching garments for virtual characters , 2006, SIGGRAPH Courses.

[6]  David A. Forsyth,et al.  Capturing and animating occluded cloth , 2007, ACM Trans. Graph..

[7]  Takeo Igarashi,et al.  Sensitive couture for interactive garment modeling and editing , 2011, SIGGRAPH 2011.

[8]  Takeo Igarashi,et al.  Sensitive couture for interactive garment modeling and editing , 2011, ACM Trans. Graph..

[9]  Yizhou Yu,et al.  DeepSketch2Face , 2017, ACM Trans. Graph..

[10]  Wolfgang Heidrich,et al.  Cloth Motion Capture , 2003, Comput. Graph. Forum.

[11]  Adrian Hilton,et al.  A Layered Model of Human Body and Garment Deformation , 2014, 2014 2nd International Conference on 3D Vision.

[12]  Charlie C. L. Wang,et al.  Styling Evolution for Tight-Fitting Garments , 2016, IEEE Transactions on Visualization and Computer Graphics.

[13]  Nobuyuki Umetani,et al.  Exploring generative 3D shapes using autoencoder networks , 2017, SIGGRAPH Asia Technical Briefs.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Marie-Paule Cani,et al.  Folded Paper Geometry from 2D Pattern and 3D Contour , 2011, Eurographics.

[16]  Alla Sheffer,et al.  Context-aware garment modeling from sketches , 2011, Comput. Graph..

[17]  Michael J. Black,et al.  DRAPE , 2012, ACM Trans. Graph..

[18]  Vladimir G. Kim,et al.  Physics-driven pattern adjustment for direct 3D garment editing , 2016, ACM Trans. Graph..

[19]  Bin Zhou,et al.  Garment Modeling from a Single Image , 2013, Comput. Graph. Forum.

[20]  Volker Scholz,et al.  Garment Motion Capture Using Color‐Coded Patterns , 2005, Comput. Graph. Forum.

[21]  Huamin Wang,et al.  Example-based wrinkle synthesis for clothing animation , 2010, SIGGRAPH 2010.

[22]  Licheng Yu,et al.  Detailed Garment Recovery from a Single-View Image , 2016, ArXiv.

[23]  Ryan White,et al.  Capturing and animating occluded cloth , 2007, SIGGRAPH 2007.

[24]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[25]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[26]  Adam Finkelstein,et al.  Suggestive contours for conveying shape , 2003, ACM Trans. Graph..

[27]  Derek Bradley,et al.  Wrinkling Captured Garments Using Space‐Time Data‐Driven Deformation , 2009, Comput. Graph. Forum.

[28]  Lin Wang,et al.  Garment modeling with a depth camera , 2015, ACM Trans. Graph..

[29]  Alla Sheffer,et al.  Virtual Garments: A Fully Geometric Approach for Clothing Design , 2006, Comput. Graph. Forum.

[30]  Peter V. Gehler,et al.  Unite the People: Closing the Loop Between 3D and 2D Human Representations , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Eitan Grinspun,et al.  Foldsketch , 2018, ACM Trans. Graph..

[32]  Charlie C. L. Wang,et al.  Flexible shape control for automatic resizing of apparel products , 2012, Comput. Aided Des..

[33]  Hyeong-Seok Ko,et al.  Garment capture from a photograph , 2015, Comput. Animat. Virtual Worlds.

[34]  Marie-Paule Cani,et al.  Sketching Folds , 2015, ACM Trans. Graph..

[35]  Michael J. Black,et al.  ClothCap , 2017, ACM Trans. Graph..

[36]  Eitan Grinspun,et al.  Parsing sewing patterns into 3D garments , 2013, ACM Trans. Graph..

[37]  Wenping Wang,et al.  BendSketch , 2017, ACM Trans. Graph..

[38]  Alla Sheffer,et al.  Design preserving garment transfer , 2012, ACM Trans. Graph..

[39]  Nobuyuki Umetani,et al.  Sensitivity-optimized rigging for example-based real-time clothing synthesis , 2014, ACM Trans. Graph..

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Huamin Wang,et al.  Rule-free sewing pattern adjustment with precision and efficiency , 2018, ACM Trans. Graph..

[42]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).