Statistical generation of 3D facial animation models

This article reports results of a modeling system that is part of a larger project which seeks to achieve perceptually realistic animations of 3D models driven by speech. This system generates individualized animated 3D face models driven by "muscles" and compatible with MPEG-4. Our main contribution is in the use of an extensive facial database and statistical techniques to generate plausible facial models from limited data: from a single image using eigenface-like statistical recognition techniques, from descriptions (identikit) or randomly within the parameters of the population represented in the facial database. An interactive module and a muscle-based animation player are also part of the system.

[1]  Shigeo Morishima,et al.  Face analysis and synthesis , 2001, IEEE Signal Process. Mag..

[2]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[3]  Henrique S. Malvar,et al.  Making Faces , 2019, Topoi.

[4]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[5]  Jian-Kang Wu,et al.  Facial image retrieval, identification, and inference system , 1993, MULTIMEDIA '93.

[6]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[7]  John Yen,et al.  Emotionally expressive agents , 1999, Proceedings Computer Animation 1999.

[8]  N. Magnenat-Thalmann,et al.  Automatic face cloning and animation using real-time facial feature tracking and speech acquisition , 2001, IEEE Signal Process. Mag..

[9]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Nadia Magnenat-Thalmann,et al.  MPEG-4 compatible faces from orthogonal photos , 1999, Proceedings Computer Animation 1999.

[11]  A. Esposito,et al.  Speech driven facial animation , 2001, PUI '01.

[12]  Keith Waters,et al.  Computer facial animation , 1996 .

[13]  Roberto Brunelli,et al.  SpotIt!An Interactive Identikit System , 1996, CVGIP Graph. Model. Image Process..

[14]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[15]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[16]  Pascal Fua,et al.  Animated Heads from Ordinary Images: A Least-Squares Approach , 1999, Comput. Vis. Image Underst..