Real-time Facial Expression Animation on An Individualized Face Using Adaptive Simulation Algorithm

This paper presents a hierarchical 3D face model of a specific person that conforms to the facial anatomy for realistic facial expression animation and a new fast algorithm for animating high-resolution facial models. Based on the accurate facial mesh reconstructed from the individual facial measurements, we develop a biomechanical face model with hierarchical structure, incorporating the skin, muscle and skull. For computational efficiency, we devise an adaptive simulation algorithm by categorizing the skin nodes into three subsets based on their dynamic characteristics. It uses either a semi-implicit integration scheme or a quasi-static solver to compute the relaxation by traversing the designed data structures in a breadth-first order. The algorithm runs in real-time and successfully synthesizes realistic facial expressions.

[1]  Manjula Patel,et al.  FACES: Facial Animation, Construction and Editing System , 1991, Eurographics.

[2]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[3]  F. I. Parke June,et al.  Computer Generated Animation of Faces , 1972 .

[4]  Mathieu Desbrun,et al.  Interactive Animation of Structured Deformable Objects , 1999, Graphics Interface.

[5]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[6]  Steve DiPaola,et al.  Extending the range of facial types , 1991, Comput. Animat. Virtual Worlds.

[7]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[8]  Nadia Magnenat-Thalmann,et al.  Simulating wrinkles and skin aging , 1999, The Visual Computer.

[9]  Nadia Magnenat-Thalmann,et al.  MPEG-4 based animation with face feature tracking , 1999, Computer Animation and Simulation.

[10]  William E. Lorensen,et al.  Decimation of triangle meshes , 1992, SIGGRAPH.

[11]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[12]  Markus Gross,et al.  Simulating facial surgery using finite element models , 1996 .

[13]  Daniel Thalmann,et al.  Simulation of Facial Muscle Actions Based on Rational Free Form Deformations , 1992, Comput. Graph. Forum.

[14]  P. Ekman,et al.  Facial Action Coding System: Manual , 1978 .

[15]  Yu Zhang,et al.  A physically-based model with adaptive refinement for facial animation , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[16]  Jörn Ostermann,et al.  Animation of synthetic faces in MPEG-4 , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[17]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.