Dynamic skin deformation simulation using musculoskeletal model and soft tissue dynamics

Deformation of skin and muscle is essential for bringing an animated character to life. This deformation is difficult to animate in a realistic fashion using traditional techniques because of the subtlety of the skin deformations that must move appropriately for the character design. In this paper, we present an algorithm that generates natural, dynamic, and detailed skin deformation (movement and jiggle) from joint angle data sequences. The algorithm consists of two steps: identification of parameters for a quasi-static muscle model using a musculoskeletal model and a short sequence of skin deformation data, and simulation of dynamic muscle and soft tissue deformation with quasi-static muscle shape and a mass-spring-damper system. We demonstrate our method using skeletal motion capture data of a subject (whose data is not used for training) to create appropriate skin deformations for muscle co-contraction and external impacts. Experimental results show that the simulated skin deformations are quantitatively and qualitatively similar to the measured actual skin deformations.

[1]  Y. Nakamura,et al.  Somatosensory computation for man-machine interface from motion-capture data and musculoskeletal human model , 2005, IEEE Transactions on Robotics.

[2]  Y. Nakamura,et al.  Macroscopic Modeling and Identification of the Human Neuromuscular Network , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Jessica K. Hodgins,et al.  Data-driven modeling of skin and muscle deformation , 2008, ACM Trans. Graph..

[4]  T. Kardel Niels Stensen's geometrical theory of muscle contraction (1667): a reappraisal. , 1990, Journal of biomechanics.

[5]  Dinesh K. Pai,et al.  Dynamic Simulation of the Hand , 2014, The Human Hand as an Inspiration for Robot Hand Development.

[6]  Michael J. Black,et al.  Breathing life into shape , 2014, ACM Trans. Graph..

[7]  Scott L Delp,et al.  3D finite element models of shoulder muscles for computing lines of actions and moment arms , 2014, Computer methods in biomechanics and biomedical engineering.

[8]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[9]  W. C. Swope,et al.  A computer simulation method for the calculation of equilibrium constants for the formation of physi , 1981 .

[10]  Thomas F. Coleman,et al.  On the convergence of interior-reflective Newton methods for nonlinear minimization subject to bounds , 1994, Math. Program..

[11]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[12]  Ken-ichi Anjyo,et al.  Practice and Theory of Blendshape Facial Models , 2014, Eurographics.

[13]  Michael J. Black,et al.  Dyna: a model of dynamic human shape in motion , 2015, ACM Trans. Graph..

[14]  Ravi Balasubramanian,et al.  The Human Hand as an Inspiration for Robot Hand Development , 2014, Springer Tracts in Advanced Robotics.

[15]  Karan Singh,et al.  Outside-in anatomy based character rigging , 2005, SCA '05.

[16]  Eftychios Sifakis,et al.  Comprehensive biomechanical modeling and simulation of the upper body , 2009, TOGS.

[17]  James F. O'Brien,et al.  Example-based wrinkle synthesis for clothing animation , 2010, ACM Trans. Graph..

[18]  Eftychios Sifakis,et al.  Realistic Biomechanical Simulation and Control of Human Swimming , 2014, ACM Trans. Graph..

[19]  R. Conatser,et al.  Muscle stiffness, strength loss, swelling and soreness following exercise‐induced injury in humans. , 1993, The Journal of physiology.

[20]  Ken Jackson,et al.  Modeling and Simulation of Skeletal Muscle for Computer Graphics: A Survey , 2012, Found. Trends Comput. Graph. Vis..

[21]  Dinesh K. Pai,et al.  Active volumetric musculoskeletal systems , 2014, ACM Trans. Graph..

[22]  Katsu Yamane,et al.  Estimation of Physically and Physiologically Valid Somatosensory Information , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Yoshihiko Nakamura,et al.  Musculoskeletal modeling and physiological validation , 2014, 2014 IEEE International Workshop on Advanced Robotics and its Social Impacts.

[24]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[25]  J. Y. S. Luh,et al.  On-Line Computational Scheme for Mechanical Manipulators , 1980 .

[26]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[27]  Katsu Yamane,et al.  Natural Motion Animation through Constraining and Deconstraining at Will , 2003, IEEE Trans. Vis. Comput. Graph..

[28]  Ronald Fedkiw,et al.  FAST 3D MUSCLE SIMULATIONS USING A NEW QUASISTATIC INVERTIBLE FINITE-ELEMENT ALGORITHM , 2005 .

[29]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[30]  Takuro Tamura,et al.  BodyParts3D: 3D structure database for anatomical concepts , 2008, Nucleic Acids Res..

[31]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[32]  Brian Wyvill,et al.  Implicit skinning , 2013, ACM Trans. Graph..