MODEL BASED FACE RECONSTRUCTION FOR ANIMATION

In this paper, we present a new semiautomatic method to reconstruct 3D facial model for animation from two orthogonal pictures taken from front and side views. The method is based on extracting the hair and face outlines and detecting interior features in the region of mouth, eyes, etc. We show how to use structured snakes for extracting the profile boundaries and facial features. Then DFFD, a deformation process, is used for modifying a predefined or generic 3D head model to produce the individualized head. Texture mapping based on cylindrical projection is employed using a composed image from the two images. The reconstructed 3D face can be animated in our facial animation system.

[1]  E. North Coleman,et al.  Obtaining 3-dimensional shape of textured and specular surfaces using four-source photometry , 1982, Comput. Graph. Image Process..

[2]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[3]  Daniel Thalmann,et al.  The Direction of Synthetic Actors in the Film Rendez-Vous a Montreal , 1987, IEEE Computer Graphics and Applications.

[4]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH.

[5]  N. Magnenat-Thalmann,et al.  Synthetic actors in computer-generated 3D films , 1990 .

[6]  Tsuneya Kurihara,et al.  A Transformation Method for Modeling and Animation of the Human Face from Photographs , 1991 .

[7]  Daniel Thalmann,et al.  Creating and Animating the Virtual World , 1992, Computer Animation Series.

[8]  Tosiyasu L. Kunii,et al.  Extraction of 3D shapes from the moving human face using lighting switch photometry , 1992 .

[9]  Ellie Baker,et al.  Evolving Line Drawings , 1993, ICGA.

[10]  P. Kalra.  An interactive multimodal facial animation system , 1993 .

[11]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[12]  Marc Levoy,et al.  Feature-based volume metamorphosis , 1995, SIGGRAPH.

[13]  Sung Yong Shin,et al.  Image metamorphosis using snakes and free-form deformations , 1995, SIGGRAPH.

[14]  Rae A. Earnshaw,et al.  Computer Graphics: Developments in Virtual Environments , 1995, Computer Graphics.

[15]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[16]  Daniel Thalmann,et al.  Towards Natural Communication in Networked Collaborative Virtual Environments , 1996 .

[17]  Pascal Fua,et al.  Taking Advantage of Image-Based and Geometry-Based Constraints to Recover 3-D Surfaces , 1996, Comput. Vis. Image Underst..

[18]  Dominique Bechmann,et al.  Facial animation , 1996, Proceedings Computer Animation '96.

[19]  Daniel Thalmann,et al.  3D Interactive Topological Modeling using Visible Human Dataset , 1996, Comput. Graph. Forum.

[20]  Nadia Magnenat-Thalmann,et al.  A user-friendly texture-fitting methodology for virtual humans , 1997, Proceedings Computer Graphics International.

[21]  Nadia Magnenat-Thalmann,et al.  Automatic 3D cloning and real-time animation of a human face , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).

[22]  Luc Van Gool,et al.  Reading between the lines—a method for extracting dynamic 3D with texture , 1997, VRST '97.

[23]  Nadia Magnenat-Thalmann,et al.  Dirichlet free-form deformations and their application to hand simulation , 1997, Proceedings. Computer Animation '97 (Cat. No.97TB100120).