Statistical Generation of 3D Facial Animable Models

This article reports results of a modeling system that is part of a larger project which seeks to achieve perceptually realistic animations of 3D models driven by speech. This system generates individualized animatable 3D face models driven by “muscles” and compatible with MPEG-4. Our main contribution is in the use of an extensive facial database and statistical techniques to generate plausible facial models from limited data: from a single image using eigenface-like statistical recognition techniques, from descriptions (identikit) or randomly within the parameters of the population represented in the facial database. An interactive module and a musclebased animation player are also part of the system.

[1]  Jian-Kang Wu,et al.  Facial image retrieval, identification, and inference system , 1993, MULTIMEDIA '93.

[2]  Keith Waters,et al.  Computer facial animation , 1996 .

[3]  Shigeo Morishima,et al.  Face analysis and synthesis , 2001, IEEE Signal Process. Mag..

[4]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[5]  Pascal Fua,et al.  Animated Heads from Ordinary Images: A Least-Squares Approach , 1999, Comput. Vis. Image Underst..

[6]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[8]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[9]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[10]  Nadia Magnenat-Thalmann,et al.  MPEG-4 compatible faces from orthogonal photos , 1999, Proceedings Computer Animation 1999.

[11]  A. Esposito,et al.  Speech driven facial animation , 2001, PUI '01.

[12]  Henrique S. Malvar,et al.  Making Faces , 2019, Topoi.