Modeling and Rendering for Realistic Facial Animation

Rendering realistic faces and facial expressions requires good models for the reflectance of skin and the motion of the face. We describe a system for modeling, animating, and rendering a face using measured data for geometry, motion, and reflectance, which realistically reproduces the appearance of a particular person’s face and facial expressions. Because we build a complete model that includes geometry and bidirectional reflectance, the face can be rendered under any illumination and viewing conditions. Our face modeling system creates structured face models with correspondences across different faces, which provide a foundation for a variety of facial animation operations.

[1]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[2]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[3]  Lance Williams,et al.  Performance-driven facial animation , 1990, SIGGRAPH.

[4]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[5]  Tony DeRose,et al.  Piecewise smooth surface reconstruction , 1994, SIGGRAPH.

[6]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[7]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[8]  Peter Shirley,et al.  Monte Carlo techniques for direct lighting calculations , 1996, TOGS.

[9]  Dimitris N. Metaxas,et al.  The integration of optical flow and deformable models with applications to human face shape and motion estimation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Donald P. Greenberg,et al.  Non-linear approximation of reflectance functions , 1997, SIGGRAPH.

[11]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[13]  Gabriel Taubin,et al.  Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Tietà , 1998, Rendering Techniques.

[14]  Henrique S. Malvar,et al.  Making Faces , 2019, Topoi.

[15]  S. Marschner,et al.  Inverse Rendering for Computer Graphics , 1998 .

[16]  Holly E. Rushmeier,et al.  Computing consistent normals and colors from photometric data , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[17]  Paolo Cignoni,et al.  Multiple Texture Stitching and Blending on 3D Objects , 1999, Rendering Techniques.

[18]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[19]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[20]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[21]  Hugues Hoppe,et al.  Displaced subdivision surfaces , 2000, SIGGRAPH.

[22]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..