Physics-inspired upsampling for cloth simulation in games

We propose a method for learning linear upsampling operators for physically-based cloth simulation, allowing us to enrich coarse meshes with mid-scale details in minimal time and memory budgets, as required in computer games. In contrast to classical subdivision schemes, our operators adapt to a specific context (e.g. a flag flapping in the wind or a skirt worn by a character), which allows them to achieve higher detail. Our method starts by pre-computing a pair of coarse and fine training simulations aligned with tracking constraints using harmonic test functions. Next, we train the upsampling operators with a new regularization method that enables us to learn mid-scale details without overfitting. We demonstrate generalizability to unseen conditions such as different wind velocities or novel character motions. Finally, we discuss how to re-introduce high frequency details not explainable by the coarse mesh alone using oscillatory modes.

[1]  Jos Stam,et al.  Nucleus: Towards a unified dynamics solver for computer graphics , 2009, 2009 11th IEEE International Conference on Computer-Aided Design and Computer Graphics.

[2]  Huamin Wang,et al.  Multi-resolution isotropic strain limiting , 2010, ACM Trans. Graph..

[3]  Hwan-Gue Cho,et al.  An efficient animation of wrinkled cloth with approximate implicit integration , 2001, The Visual Computer.

[4]  Matthias Müller,et al.  Wrinkle meshes , 2010, SCA '10.

[5]  Jernej Barbic,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, ACM Trans. Graph..

[6]  Ronald Fedkiw,et al.  Robust treatment of collisions, contact and friction for cloth animation , 2002, SIGGRAPH Courses.

[7]  Edilson de Aguiar,et al.  Stable spaces for real-time clothing , 2010, ACM Trans. Graph..

[8]  Jernej Barbic,et al.  Deformable object animation using reduced optimal control , 2009, ACM Trans. Graph..

[9]  Matthias Müller,et al.  Position based dynamics , 2007, J. Vis. Commun. Image Represent..

[10]  Peter-Pike J. Sloan,et al.  Fast and Efficient Skinning of Animated Meshes , 2010, Comput. Graph. Forum.

[11]  Mathieu Desbrun,et al.  Discrete shells , 2003, SCA '03.

[12]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[13]  Jeongjin Lee,et al.  A real-time cloth draping simulation algorithm using conjugate harmonic functions , 2007, Comput. Graph..

[14]  Jörn Loviscach Wrinkling Coarse Meshes on the GPU , 2006, Comput. Graph. Forum.

[15]  Ulrich Pinkall,et al.  Computing Discrete Minimal Surfaces and Their Conjugates , 1993, Exp. Math..

[16]  Daniel Cohen-Or,et al.  Geometry-aware bases for shape approximation , 2005, IEEE Transactions on Visualization and Computer Graphics.

[17]  Xavier Provot,et al.  Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior , 1995 .

[18]  Konstantinos Dinos Tsiknis Better cloth through unbiased strain limiting and physics-aware subdivision , 2006 .

[19]  Cassidy J. Curtis,et al.  An art-directed wrinkle system for CG character clothing , 2005, SCA '05.

[20]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[21]  Byung-Uck Kim,et al.  A deformation transformer for real-time cloth animation , 2010, ACM Trans. Graph..

[22]  Robert Bridson,et al.  Animating developable surfaces using nonconforming elements , 2008, ACM Trans. Graph..

[23]  Alla Sheffer,et al.  Animation wrinkling: augmenting coarse cloth simulations with realistic-looking wrinkles , 2010, ACM Trans. Graph..

[24]  Marie-Paule Cani,et al.  Real-time dynamic wrinkles , 2004, Proceedings Computer Graphics International, 2004..

[25]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[26]  Wolfgang Straßer,et al.  Continuum‐based Strain Limiting , 2009, Comput. Graph. Forum.

[27]  Jernej Barbic,et al.  Real-time control of physically based simulations using gentle forces , 2008, ACM Trans. Graph..

[28]  John P. Lewis,et al.  Practical least-squares for computer graphics: Video files associated with this course are available from the citation page , 2007, SIGGRAPH Courses.

[29]  Sebastian Thrun,et al.  Video-based reconstruction of animatable human characters , 2010, ACM Trans. Graph..

[30]  Nadia Magnenat-Thalmann,et al.  A data-driven approach for real-time clothes simulation , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[31]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[32]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[33]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[34]  Eitan Grinspun,et al.  TRACKS: toward directable thin shells , 2007, ACM Trans. Graph..

[35]  Tae-Yong Kim,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2008) Drivenshape -a Data-driven Approach for Shape Deformation , 2022 .

[36]  Thomas Jakobsen,et al.  Advanced Character Physics , 2003 .

[37]  Eitan Grinspun,et al.  Discrete quadratic curvature energies , 2006, Comput. Aided Geom. Des..

[38]  Bruno Lévy,et al.  Spectral Geometry Processing with Manifold Harmonics , 2008, Comput. Graph. Forum.

[39]  Eitan Grinspun,et al.  Asynchronous contact mechanics , 2009, ACM Trans. Graph..

[40]  John Anderson,et al.  Animating oscillatory motion with overlap: wiggly splines , 2008, ACM Trans. Graph..

[41]  Tony DeRose,et al.  Subdivision surfaces in character animation , 1998, SIGGRAPH.

[42]  Ronald K. Thornton,et al.  Real-Time Physics , 1998 .

[43]  Adam W. Bargteil,et al.  Physics-inspired upsampling for cloth simulation in games , 2011, SIGGRAPH 2011.

[44]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[45]  Bruno Levy,et al.  Spectral Geometry Processing , 2009 .

[46]  Matthias Müller,et al.  Hierarchical Position Based Dynamics , 2008, VRIPHYS.

[47]  Eitan Grinspun,et al.  To appear in the ACM SIGGRAPH conference proceedings Efficient Simulation of Inextensible Cloth , 2007 .

[48]  Dirk Roose,et al.  Smoothing of meshes and point clouds using weighted geometry-aware bases , 2005 .

[49]  Nadia Magnenat-Thalmann,et al.  Animating wrinkles on clothes , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[50]  James F. O'Brien,et al.  Example-based wrinkle synthesis for clothing animation , 2010, ACM Trans. Graph..

[51]  Doug L. James,et al.  Precomputing interactive dynamic deformable scenes , 2003, ACM Trans. Graph..