Transfer facial expressions with identical topology

We present a novel method to produce realistic expressions and animations by transferring existing expressions from a given facial model to a new facial model. The representation of the target model is first converted to make its topology the same as the source model. The radial basis function is employed to deform the template meshes to fit the target model. We then map all the vertices to the surface of the target model while preserving its spatial relationships with neighboring vertices. Therefore, facial expressions and motions can be faithfully transferred between models. With this method, a person can create many different models with the same animated expression even if these models have different topologies and, for any given model, a person can create many different expressions.

[1]  Hyeong-Seok Ko,et al.  Performance-driven muscle-based facial animation , 2001, Comput. Animat. Virtual Worlds.

[2]  Sung Yong Shin,et al.  An example-based approach for facial expression cloning , 2003, SCA '03.

[3]  G. Taubin.  LINEAR ANISOTROPIC MESH FILTERING , 2001 .

[4]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[5]  Keith Waters,et al.  A coordinated muscle model for speech animation , 1995 .

[6]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[7]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[8]  Daniel Cohen-Or,et al.  Three-dimensional distance field metamorphosis , 1998, TOGS.

[9]  Leif Kobbelt,et al.  Real‐Time Shape Editing using Radial Basis Functions , 2005, Comput. Graph. Forum.

[10]  Kun Zhou,et al.  Mesh editing with poisson-based gradient field manipulation , 2004, ACM Trans. Graph..

[11]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[12]  Dominique Bechmann,et al.  A survey of spatial deformation from a user-centered perspective , 2008, TOGS.

[13]  Greg Turk,et al.  Robust Creation of Implicit Surfaces from Polygonal Meshes , 2002, IEEE Trans. Vis. Comput. Graph..

[14]  Ronald Fedkiw,et al.  Automatic determination of facial muscle activations from sparse motion capture marker data , 2005, SIGGRAPH '05.

[15]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[16]  Jun-yong Noh,et al.  Animated deformations with radial basis functions , 2000, VRST '00.

[17]  Ross T. Whitaker,et al.  Geometric surface smoothing via anisotropic diffusion of normals , 2002, IEEE Visualization, 2002. VIS 2002..

[18]  Marc Alexa,et al.  A sketch-based interface for detail-preserving mesh editing , 2007, SIGGRAPH Courses.

[19]  Jovan Popovic,et al.  Deformation transfer for triangle meshes , 2004, ACM Trans. Graph..

[20]  Daniel Cohen-Or,et al.  Bilateral mesh denoising , 2003 .

[21]  Christoph Bregler,et al.  Facial expression space learning , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[22]  Yutaka Ohtake,et al.  Mesh denoising via iterative alpha-trimming and nonlinear diffusion of normals with automatic thresholding , 2003, Proceedings Computer Graphics International 2003.

[23]  Roberto Scopigno,et al.  Computer Graphics forum , 2003, Computer Graphics Forum.

[24]  Ronald A. Cole,et al.  Accurate automatic visible speech synthesis of arbitrary 3D models based on concatenation of diviseme motion capture data , 2004, Comput. Animat. Virtual Worlds.

[25]  Ari Rappoport,et al.  Simple constrained deformations for geometric modeling and interactive design , 1994, TOGS.

[26]  Christoph Bregler,et al.  Mood swings: expressive speech animation , 2005, TOGS.

[27]  Daniel Thalmann,et al.  Simulation of Facial Muscle Actions Based on Rational Free Form Deformations , 1992, Comput. Graph. Forum.

[28]  Hanspeter Pfister,et al.  Face transfer with multilinear models , 2005, ACM Trans. Graph..

[29]  Jun-yong Noh,et al.  Expression cloning , 2001, SIGGRAPH.

[30]  Zhigang Deng,et al.  Animating blendshape faces by cross-mapping motion capture data , 2006, I3D '06.