Animation, simulation, and control of soft characters using layered representations and simplified physics-based methods

Realistic behavior of computer generated characters is key to bringing virtual environments, computer games, and other interactive applications to life. The plausibility of a virtual scene is strongly influenced by the way objects move around and interact with each other. Traditionally, actions are limited to motion capture driven or pre-scripted motion of the characters. Physics enhance the sense of realism: physical simulation is required to make objects act as expected in real life. To make gaming and virtual environments truly immersive, it is crucial to simulate the response of characters to collisions and to produce secondary effects such as skin wrinkling and muscle bulging. Unfortunately, existing techniques cannot generally achieve these effects in real time, do not address the coupled response of a character's skeleton and skin to collisions nor do they support artistic control. In this dissertation, I present interactive algorithms that enable physical simulation of deformable characters with high surface detail and support for intuitive deformation control. I propose a novel unified framework for real-time modeling of soft objects with skeletal deformations and surface deformation due to contact, and their interplay for object surfaces with up to tens of thousands of degrees of freedom. I make use of layered models to reduce computational complexity. I introduce dynamic deformation textures, which map three dimensional deformations in the deformable skin layer to a two dimensional domain for extremely efficient parallel computation of the dynamic elasticity equations and optimized hierarchical collision detection. I also enhance layered models with responsive contact handling, to support the interplay between skeletal motion and surface contact and the resulting two-way coupling effects. Finally, I present dynamic morph targets, which enable intuitive control of dynamic skin deformations at run-time by simply sculpting pose-specific surface shapes. The resulting framework enables real-time and directable simulation of soft articulated characters with frictional contact response, capturing the interplay between skeletal dynamics and complex, non-linear skin deformations.

[1]  C. Karen Liu,et al.  Learning physics-based motion style with nonlinear inverse optimization , 2005, ACM Trans. Graph..

[2]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[3]  M. Levas OBBTree : A Hierarchical Structure for Rapid Interference Detection , .

[4]  Zoran Popovic,et al.  Physically based motion transformation , 1999, SIGGRAPH.

[5]  Christian Duriez,et al.  Signorini's contact model for deformable objects in haptic simulations , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[6]  Michael F. Cohen,et al.  Controlling dynamic simulation with kinematic constraints , 1987, SIGGRAPH.

[7]  Eitan Grinspun,et al.  TRACKS: toward directable thin shells , 2007, SIGGRAPH 2007.

[8]  Reinhard Klein,et al.  GPU‐based Collision Detection for Deformable Parameterized Surfaces , 2006, Comput. Graph. Forum.

[9]  Dinesh Manocha,et al.  CULLIDE: interactive collision detection between complex models in large environments using graphics hardware , 2003, HWWS '03.

[10]  Hyeong-Seok Ko,et al.  Modal warping: real-time simulation of large rotational deformation and manipulation , 2004, IEEE Transactions on Visualization and Computer Graphics.

[11]  P. Song,et al.  Distributed Compliant Model for Efficient Dynamic Simulation of Systems With Frictional Contacts , 2003, DAC 2003.

[12]  Demetri Terzopoulos,et al.  Heads up!: biomechanical modeling and neuromuscular control of the neck , 2006, SIGGRAPH 2006.

[13]  John P. Lewis,et al.  Real‐Time Weighted Pose‐Space Deformation on the GPU , 2006, Comput. Graph. Forum.

[14]  Mark J. Harris Mapping computational concepts to GPUs , 2005, SIGGRAPH Courses.

[15]  Zheng Guo,et al.  Skinning With Deformable Chunks , 2005, Comput. Graph. Forum.

[16]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[17]  Markus H. Gross,et al.  Interactive Haptic Rendering of High-Resolution Deformable Objects , 2007, HCI.

[18]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH 2006.

[19]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[20]  Apurva Shah,et al.  Session details: Course 6: Anyone can cook: inside Ratatouille's kitchen , 2007, ACM SIGGRAPH 2007 courses.

[21]  Tsuneya Kurihara,et al.  Modeling deformable human hands from medical images , 2004, SCA '04.

[22]  Markus H. Gross,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Adaptive Deformations with Fast Tight Bounds , 2022 .

[23]  Leonard McMillan,et al.  Stable real-time deformations , 2002, SCA '02.

[24]  Wayne E. Carlson,et al.  Anatomy-based modeling of the human musculature , 1997, SIGGRAPH.

[25]  Steve Capell,et al.  A multiresolution framework for dynamic deformations , 2002, SCA '02.

[26]  Dinesh K. Pai,et al.  Fast frictional dynamics for rigid bodies , 2005, SIGGRAPH 2005.

[27]  Ming C. Lin,et al.  Haptic Rendering : Foundations, Algorithms, and Applications , 2008 .

[28]  Susan Fisher,et al.  An improved finite-element contact model for anatomical simulations , 2003, The Visual Computer.

[29]  Z. Popovic,et al.  Interactive skeleton-driven dynamic deformations , 2002, ACM Trans. Graph..

[30]  Victor B. Zordan,et al.  Dynamic response for motion capture animation , 2005, SIGGRAPH '05.

[31]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[32]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[33]  Olga Sorkine-Hornung,et al.  Context‐Aware Skeletal Shape Deformation , 2007, Comput. Graph. Forum.

[34]  James Diebel,et al.  Representing Attitude : Euler Angles , Unit Quaternions , and Rotation Vectors , 2006 .

[35]  P. Wriggers,et al.  FINITE ELEMENT FORMULATION OF LARGE DEFORMATION IMPACT-CONTACT PROBLEMS WITH FRICTION , 1990 .

[36]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[37]  J. Oden,et al.  Contact Problems in Elasticity: A Study of Variational Inequalities and Finite Element Methods , 1987 .

[38]  Pedro V. Sander,et al.  Texture mapping progressive meshes , 2001, SIGGRAPH.

[39]  Andrew P. Witkin,et al.  Dynamic simulation of non-penetrating flexible bodies , 1992, SIGGRAPH.

[40]  Nancy S. Pollard,et al.  Efficient synthesis of physically valid human motion , 2003, ACM Trans. Graph..

[41]  Jane Wilhelms,et al.  Anatomically based modeling , 1997, SIGGRAPH.

[42]  David Baraff,et al.  Linear-time dynamics using Lagrange multipliers , 1996, SIGGRAPH.

[43]  Matthew West,et al.  Decomposition contact response (DCR) for explicit finite element dynamics , 2005, International Journal for Numerical Methods in Engineering.

[44]  Sean Quinlan,et al.  Efficient distance computation between non-convex objects , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[45]  Timothy A. Davis,et al.  A column approximate minimum degree ordering algorithm , 2000, TOMS.

[46]  Alan H. Barr,et al.  Global and local deformations of solid primitives , 1984, SIGGRAPH.

[47]  Dinesh Manocha,et al.  Collision and Proximity Queries , 2004, Handbook of Discrete and Computational Geometry, 2nd Ed..

[48]  Ming C. Lin,et al.  Efficient collision detection for animation and robotics , 1993 .

[49]  Wolfgang Straßer,et al.  Corotational Simulation of Deformable Solids , 2004, WSCG.

[50]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[51]  Koji Komatsu,et al.  Human skin model capable of natural shape variation , 1988, The Visual Computer.

[52]  Morgan McGuire,et al.  Real-Time Collision Deformations using Graphics Hardware , 2005, J. Graph. Tools.

[53]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[54]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[55]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[56]  Leonidas J. Guibas,et al.  Quasi-rigid objects in contact , 2004, SCA '04.

[57]  Chen Shen,et al.  Interactive Deformation Using Modal Analysis with Constraints , 2003, Graphics Interface.

[58]  Wolfgang Straßer,et al.  Analysis of numerical methods for the simulation of deformable models , 2003, The Visual Computer.

[59]  Sabine Coquillart,et al.  Extended free-form deformation: a sculpturing tool for 3D geometric modeling , 1990, SIGGRAPH.

[60]  Ronald Fedkiw,et al.  Volume conserving finite element simulations of deformable models , 2007, ACM Trans. Graph..

[61]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[62]  Ronald Fedkiw,et al.  Robust quasistatic finite elements and flesh simulation , 2005, SCA '05.

[63]  Ming C. Lin,et al.  Accurate and Fast Proximity Queries Between Polyhedra Using Convex Surface Decomposition , 2001, Comput. Graph. Forum.

[64]  Steve Capell,et al.  Interactive character animation using dynamic elastic simulation , 2004 .

[65]  J. Shewchuk An Introduction to the Conjugate Gradient Method Without the Agonizing Pain , 1994 .

[66]  Jessica K. Hodgins,et al.  Graphical modeling and animation of brittle fracture , 1999, SIGGRAPH.

[67]  Pradeep Dubey,et al.  Larrabee: A Many-Core x86 Architecture for Visual Computing , 2009, IEEE Micro.

[68]  George Maestri,et al.  Digital character animation , 1996 .

[69]  Dinesh K. Pai,et al.  Post-stabilization for rigid body simulation with contact and constraints , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[70]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[71]  Daniel Thalmann,et al.  The Elastic Surface Layer Model for Animated Character Construction , 1993 .

[72]  J. Canny,et al.  Real-time Simulation of Physically Realistic Global Deformation , 1999 .

[73]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[74]  Jean-Christophe Lombardo,et al.  Real-time collision detection for virtual surgery , 1999, Proceedings Computer Animation 1999.

[75]  George Karypis Multi-Constraint Mesh Partitioning for Contact/Impact Computations , 2003, SC.

[76]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[77]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[78]  Ming C. Lin,et al.  Accelerated proximity queries between convex polyhedra by multi-level Voronoi marching , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[79]  Gordon Clapworthy,et al.  An Anatomy-Based Approach to Human Muscle Modeling and Deformation , 2002, IEEE Trans. Vis. Comput. Graph..

[80]  Jernej Barbic,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, ACM Trans. Graph..

[81]  David Bommes,et al.  Efficient Linear System Solvers for Mesh Processing , 2005, IMA Conference on the Mathematics of Surfaces.

[82]  Jessica K. Hodgins,et al.  Animating Sand, Mud, and Snow , 1999, Comput. Graph. Forum.

[83]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2005, Eurographics.

[84]  Dinesh Manocha,et al.  Fast and simple 2D geometric proximity queries using graphics hardware , 2001, I3D '01.

[85]  Dinesh K. Pai,et al.  BD-tree: output-sensitive collision detection for reduced deformable models , 2004, ACM Trans. Graph..

[86]  Brian Mirtich,et al.  A Survey of Deformable Modeling in Computer Graphics , 1997 .

[87]  Jirí Zára,et al.  Skinning with dual quaternions , 2007, SI3D.

[88]  Marie-Paule Gascuel Layered Deformable Models with Implicit Surfaces. , 1998 .

[89]  Andrew P. Witkin,et al.  Fast animation and control of nonrigid structures , 1990, SIGGRAPH.

[90]  Hervé Delingette,et al.  Nonlinear and anisotropic elastic soft tissue models for medical simulation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[91]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[92]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[93]  Dimitris N. Metaxas,et al.  Dynamic deformation of solid primitives with constraints , 1992, SIGGRAPH.

[94]  Steve Capell,et al.  Physically based rigging for deformable characters , 2005, SCA '05.

[95]  Kenny Erleben,et al.  Stable, Robust, and Versatile Multibody Dynamics Animation , 2005 .

[96]  Darwyn Peachey,et al.  An effects recipe for rolling a dough, cracking an egg and pouring a sauce , 2007, SIGGRAPH '07.

[97]  Jirí Zára,et al.  Spherical blend skinning: a real-time deformation of articulated models , 2005, I3D '05.

[98]  M. Teschner,et al.  Meshless deformations based on shape matching , 2005, SIGGRAPH 2005.

[99]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[100]  Philip M. Hubbard,et al.  Collision Detection for Interactive Graphics Applications , 1995, IEEE Trans. Vis. Comput. Graph..

[101]  Ronald Fedkiw,et al.  Invertible finite elements for robust simulation of large deformation , 2004, SCA '04.

[102]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[103]  Hans-Peter Seidel,et al.  Meshless modeling of deformable shapes and their motion , 2008, SCA '08.

[104]  Peter Schröder,et al.  Interactive multiresolution mesh editing , 1997, SIGGRAPH.

[105]  Dinesh Manocha,et al.  Fast distance queries with rectangular swept sphere volumes , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[106]  Daniel Thalmann,et al.  Joint-dependent local deformations for hand animation and object grasping , 1989 .

[107]  Ronald Fedkiw,et al.  Dynamic simulation of articulated rigid bodies with contact and collision , 2006, IEEE Transactions on Visualization and Computer Graphics.

[108]  Eitan Grinspun,et al.  CHARMS: a simple framework for adaptive simulation , 2002, ACM Trans. Graph..

[109]  Gabriel Zachmann,et al.  Collision Detection for Deformable Objects , 2004, Comput. Graph. Forum.

[110]  Leonidas J. Guibas,et al.  H-Walk: hierarchical distance computation for moving convex bodies , 1999, SCG '99.

[111]  Ming C. Lin,et al.  A fast algorithm for incremental distance calculation , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[112]  Markus Gross,et al.  Simulating facial surgery using finite element models , 1996 .

[113]  Dinesh K. Pai,et al.  Musculotendon simulation for hand animation , 2008, SIGGRAPH 2008.

[114]  Ming C. Lin,et al.  Haptic display of interaction between textured models , 2004, IEEE Visualization 2004.

[115]  Doug L. James,et al.  Skinning mesh animations , 2005, ACM Trans. Graph..

[116]  Brian Mirtich,et al.  Impulse-based dynamic simulation of rigid body systems , 1996 .

[117]  Joseph S. B. Mitchell,et al.  Efficient Collision Detection Using Bounding Volume Hierarchies of k-DOPs , 1998, IEEE Trans. Vis. Comput. Graph..

[118]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three-dimensional space , 1988, IEEE J. Robotics Autom..

[119]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[120]  O. Schenk,et al.  ON FAST FACTORIZATION PIVOTING METHODS FOR SPARSE SYMMETRI C INDEFINITE SYSTEMS , 2006 .

[121]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[122]  James F. O'Brien,et al.  Graphical modeling and animation of ductile fracture , 2002, SIGGRAPH '02.

[123]  Dinesh Manocha,et al.  Collision queries using oriented bounding boxes , 2000 .

[124]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, ACM Trans. Graph..

[125]  Doug L. James,et al.  Precomputing interactive dynamic deformable scenes , 2003, ACM Trans. Graph..

[126]  Ken-ichi Anjyo,et al.  Directable animation of elastic objects , 2005, SCA '05.