HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics

We propose a method that leverages graph neural networks, multi-level message passing, and unsupervised training to enable real-time prediction of realistic clothing dynamics. Whereas existing methods based on linear blend skinning must be trained for specific garments, our method is agnostic to body shape and applies to tight-fitting garments as well as loose, free-flowing clothing. Our method furthermore handles changes in topology (e.g., garments with buttons or zippers) and material properties at inference time. As one key contribution, we propose a hierarchical message-passing scheme that efficiently propagates stiff stretching modes while preserving local detail. We empirically show that our method outperforms strong baselines quantitatively and that its results are perceived as more realistic than state-of-the-art methods.

[1]  M. Budagavi,et al.  Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Image , 2022, ACCV.

[2]  N. Mitra,et al.  Motion Guided Deep Dynamic 3D Garments , 2022, ACM Trans. Graph..

[3]  P. Fua,et al.  DIG: Draping Implicit Garment over the Human Body , 2022, ACCV.

[4]  Hongwen Zhang,et al.  Learning Implicit Templates for Point-Based Clothed Human Modeling , 2022, ECCV.

[5]  Tianjia Shao,et al.  Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks , 2022, SIGGRAPH.

[6]  M. Otaduy,et al.  SNUG: Self-Supervised Neural Dynamic Garments , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Michael J. Black,et al.  The Power of Points for Modeling Humans in Clothing , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[8]  W. Matusik,et al.  DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contact , 2021, ACM Trans. Graph..

[9]  Anil A. Bharath,et al.  Simulating Continuum Mechanics with Multi-Scale Graph Neural Networks , 2021, ArXiv.

[10]  Miguel A. Otaduy,et al.  Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Kirill Mazur,et al.  Point-Based Modeling of Human Clothing , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Michael J. Black,et al.  SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[13]  Francesc Moreno-Noguer,et al.  SMPLicit: Topology-aware Generative Model for Clothed People , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  M. Madadi,et al.  PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformation , 2020, 2012.11310.

[15]  Chenfanfu Jiang,et al.  Codimensional incremental potential contact , 2020, ACM Trans. Graph..

[16]  Tao Yu,et al.  DeepCloth: Neural Garment Representation for Shape and Style Editing , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  T. Pfaff,et al.  Learning Mesh-Based Simulation with Graph Networks , 2020, ICLR.

[18]  M. Madadi,et al.  DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation , 2020, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Bernhard Thomaszewski,et al.  Computational design of skintight clothing , 2020, ACM Trans. Graph..

[20]  Bernhard Thomaszewski,et al.  ADD , 2020, ACM Trans. Graph..

[21]  Chaitanya Patel,et al.  TailorNet: Predicting Clothing in 3D as a Function of Human Pose, Shape and Garment Style , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[23]  M. Madadi,et al.  CLOTH3D: Clothed 3D Humans , 2019, ECCV.

[24]  Michael J. Black,et al.  Learning to Dress 3D People in Generative Clothing , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Nikolaus F. Troje,et al.  AMASS: Archive of Motion Capture As Surface Shapes , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[27]  Miguel A. Otaduy,et al.  Learning‐Based Animation of Clothing for Virtual Try‐On , 2019, Comput. Graph. Forum.

[28]  Rahul Narain,et al.  Accurate dissipative forces in optimization integrators , 2018, ACM Trans. Graph..

[29]  Eitan Grinspun,et al.  Foldsketch: enriching garments with physically reproducible folds , 2018, ACM Trans. Graph..

[30]  Michael J. Black,et al.  SMPL: A Skinned Multi-Person Linear Model , 2023 .

[31]  Miguel A. Otaduy,et al.  Yarn-level simulation of woven cloth , 2014, ACM Trans. Graph..

[32]  James F. O'Brien,et al.  Adaptive anisotropic remeshing for cloth simulation , 2012, ACM Trans. Graph..

[33]  Michael J. Black,et al.  DRAPE , 2012, ACM Trans. Graph..

[34]  Steve Marschner,et al.  Data‐Driven Estimation of Cloth Simulation Models , 2012, Comput. Graph. Forum.

[35]  Eitan Grinspun,et al.  Example-based elastic materials , 2011, ACM Trans. Graph..

[36]  Huamin Wang,et al.  Data-driven elastic models for cloth: modeling and measurement , 2011, ACM Trans. Graph..

[37]  Nadia Magnenat-Thalmann,et al.  A simple approach to nonlinear tensile stiffness for accurate cloth simulation , 2009, TOGS.

[38]  Eitan Grinspun,et al.  Asynchronous contact mechanics , 2009, ACM Trans. Graph..

[39]  Hyeongseok Ko,et al.  Stable but responsive cloth , 2005, ACM Trans. Graph..

[40]  Mathieu Desbrun,et al.  Discrete shells , 2003, SCA '03.

[41]  Jessica K. Hodgins,et al.  Estimating cloth simulation parameters from video , 2003, SCA '03.

[42]  R. Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.

[43]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[44]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[45]  Minchen Li,et al.  Bi-Stride Multi-Scale Graph Neural Network for Mesh-Based Physical Simulation , 2022, ArXiv.

[46]  A. Pritzel,et al.  MultiScale MeshGraphNets , 2022, ArXiv.

[47]  M. Otaduy,et al.  ULNeF: Untangled Layered Neural Fields for Mix-and-Match Virtual Try-On , 2022, NeurIPS.

[48]  D. Rohmer,et al.  Implicit Untangling: A Robust Solution for Modeling Layered Clothing , 2020 .

[49]  Ming C. Lin,et al.  Differentiable Cloth Simulation for Inverse Problems , 2019, NeurIPS.

[50]  Min Tang I-Cloth: Incremental Collision Handling for GPU-Based Interactive Cloth Simulation , 2018 .

[51]  Wolfgang Straßer,et al.  Asynchronous Cloth Simulation , 2008 .

[52]  Samuel B. Williams,et al.  ASSOCIATION FOR COMPUTING MACHINERY , 2000 .