Stable spaces for real-time clothing

We present a technique for learning clothing models that enables the simultaneous animation of thousands of detailed garments in real-time. This surprisingly simple conditional model learns and preserves the key dynamic properties of a cloth motion along with folding details. Our approach requires no a priori physical model, but rather treats training data as a "black box." We show that the models learned with our method are stable over large time-steps and can approximately resolve cloth-body collisions. We also show that within a class of methods, no simpler model covers the full range of cloth dynamics captured by ours. Our method bridges the current gap between skinning and physical simulation, combining benefits of speed from the former with dynamic effects from the latter. We demonstrate our approach on a variety of apparel worn by male and female human characters performing a varied set of motions typically used in video games (e.g., walking, running, jumping, etc.).

[1]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[2]  Nadia Magnenat-Thalmann,et al.  Real‐time Animation of Dressed Virtual Humans , 2002, Comput. Graph. Forum.

[3]  Andrew P. Witkin,et al.  Untangling cloth , 2003, ACM Trans. Graph..

[4]  Mats Viberg,et al.  Subspace-based methods for the identification of linear time-invariant systems , 1995, Autom..

[5]  Ronald Fedkiw,et al.  Ieee Transactions on Visualization and Computer Graphics 1 Robust High-resolution Cloth Using Parallelism, History-based Collisions and Accurate Friction , 2022 .

[6]  Geoffrey E. Hinton,et al.  Parameter estimation for linear dynamical systems , 1996 .

[7]  Johan A. K. Suykens,et al.  Identification of stable models in subspace identification by using regularization , 2001, IEEE Trans. Autom. Control..

[8]  Doug L. James,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, SIGGRAPH 2005.

[9]  Yiorgos Chrysanthou,et al.  Fast Cloth Animation on Walking Avatars , 2001, Comput. Graph. Forum.

[10]  Neil D. Lawrence,et al.  Probabilistic Non-linear Principal Component Analysis with Gaussian Process Latent Variable Models , 2005, J. Mach. Learn. Res..

[11]  Ronald Fedkiw,et al.  Simulation of clothing with folds and wrinkles , 2003, SCA '03.

[12]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[13]  Peter-Pike J. Sloan,et al.  Fast and Efficient Skinning of Animated Meshes , 2010, Comput. Graph. Forum.

[14]  Mathieu Desbrun,et al.  Discrete shells , 2003, SCA '03.

[15]  Dinesh K. Pai,et al.  Modeling Stochastic Dynamical Systems for Interactive Simulation , 2001, Comput. Graph. Forum.

[16]  Doug L. James,et al.  Skinning mesh animations , 2005, SIGGRAPH 2005.

[17]  Doug L. James,et al.  Precomputing interactive dynamic deformable scenes , 2003, ACM Trans. Graph..

[18]  Hwan-Gue Cho,et al.  Bilayered approximate integration for rapid and plausible animation of virtual cloth with realistic wrinkles , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[19]  Z. Popovic,et al.  Model reduction for real-time fluids , 2006, SIGGRAPH 2006.

[20]  Robert Bridson,et al.  Animating developable surfaces using nonconforming elements , 2008, SIGGRAPH 2008.

[21]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[22]  Hwan-Gue Cho,et al.  An efficient animation of wrinkled cloth with approximate implicit integration , 2001, The Visual Computer.

[23]  David Harmon,et al.  Asynchronous contact mechanics , 2009, SIGGRAPH 2009.

[24]  Ronald Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.

[25]  Isaac Rudomín,et al.  Real-Time Clothing: Geometry and Physics , 2002, WSCG.

[26]  Byron Boots,et al.  A Constraint Generation Approach to Learning Stable Linear Dynamical Systems , 2007, NIPS.

[27]  Bruno Arnaldi,et al.  Dynamic skinning: adding real-time dynamic effects to an existing character animation , 2005, SCCG '05.

[28]  Jan M. Maciejowski,et al.  Realization of stable models with subspace methods , 1996, Autom..

[29]  Dennis S. Bernstein,et al.  Subspace identification with guaranteed stability using constrained optimization , 2003, IEEE Trans. Autom. Control..

[30]  Doug L. James,et al.  Optimizing cubature for efficient integration of subspace deformations , 2008, SIGGRAPH 2008.

[31]  Jos Stam,et al.  Nucleus: Towards a unified dynamics solver for computer graphics , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[32]  Bart De Moor,et al.  Subspace Identification for Linear Systems: Theory ― Implementation ― Applications , 2011 .

[33]  Nadia Magnenat-Thalmann,et al.  A data-driven approach for real-time clothes simulation , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[34]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[35]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[36]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[37]  Nadia Magnenat-Thalmann,et al.  Implicit midpoint integration and adaptive damping for efficient cloth simulation: Collision Detection and Deformable Objects , 2005 .

[38]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[39]  Geoffrey E. Hinton,et al.  Stochastic Neighbor Embedding , 2002, NIPS.

[40]  Raanan Fattal,et al.  Efficient simulation of inextensible cloth , 2007, SIGGRAPH 2007.

[41]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[42]  Tae-Yong Kim,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2008) Drivenshape -a Data-driven Approach for Shape Deformation , 2022 .