Data-driven modeling of skin and muscle deformation

In this paper, we present a data-driven technique for synthesizing skin deformation from skeletal motion. We first create a database of dynamic skin deformations by recording the motion of the surface of the skin with a very large set of motion capture markers. We then build a statistical model of the deformations by dividing them into two parts: static and dynamic. Static deformations are modeled as a function of pose. Dynamic deformations are caused by the actions of the muscles as they move the joints and the inertia of muscles and fat. We approximate these effects by fitting a set of dynamic equations to the pre-recorded data. We demonstrate the viability of this approach by generating skin deformations from the skeletal motion of an actor. We compare the generated animation both to synchronized video of the actor and to ground truth animation created directly from the large marker set.

[1]  Hyeong-Seok Ko,et al.  Modal warping: real-time simulation of large rotational deformation and manipulation , 2004, IEEE Transactions on Visualization and Computer Graphics.

[2]  Takeo Kanade,et al.  Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[3]  Dinesh K. Pai,et al.  EigenSkin: real time large deformation character skinning in hardware , 2002, SCA '02.

[4]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[5]  Jovan Popovic,et al.  Continuous capture of skin deformation , 2003, ACM Trans. Graph..

[6]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[7]  Alexis Angelidis,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Kinodynamic Skinning Using Volume-preserving Deformations , 2022 .

[8]  Daniel Thalmann,et al.  Anatomic modeling of deformable human bodies , 2000, The Visual Computer.

[9]  Zheng Guo,et al.  Skinning With Deformable Chunks , 2005, Comput. Graph. Forum.

[10]  Jirí Zára,et al.  Spherical blend skinning: a real-time deformation of articulated models , 2005, I3D '05.

[11]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[12]  Karan Singh,et al.  Outside-in anatomy based character rigging , 2005, SCA '05.

[13]  Ronald Fedkiw,et al.  Robust quasistatic finite elements and flesh simulation , 2005, SCA '05.

[14]  Jernej Barbic,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, ACM Trans. Graph..

[15]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[16]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[17]  Jessica K. Hodgins,et al.  Capturing and animating skin deformation in human motion , 2006, SIGGRAPH '06.

[18]  Michael Gleicher,et al.  Building efficient, accurate character skins from examples , 2003, ACM Trans. Graph..

[19]  Jovan Popovic,et al.  Inverse kinematics for reduced deformable models , 2006, SIGGRAPH '06.

[20]  Wayne E. Carlson,et al.  Anatomy-based modeling of the human musculature , 1997, SIGGRAPH.

[21]  Bert Jüttler,et al.  Sweep-based human deformation , 2005, The Visual Computer.

[22]  B. Nigg,et al.  The effect of muscle stiffness and damping on simulated impact force peaks during running. , 1999, Journal of biomechanics.

[23]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[24]  Cary B. Phillips,et al.  Multi-weight enveloping: least-squares approximation techniques for skin animation , 2002, SCA '02.

[25]  Jane Wilhelms,et al.  Anatomically based modeling , 1997, SIGGRAPH.