Expressive expression mapping with ratio images

Facial expressions exhibit not only facial feature motions, but also subtle changes in illumination and appearance (e.g., facial creases and wrinkles). These details are important visual cues, but they are difficult to synthesize. Traditional expression mapping techniques consider feature motions while the details in illumination changes are ignored. In this paper, we present a novel technique for facial expression mapping. We capture the illumination change of one person's expression in what we call an expression ratio image (ERI). Together with geometric warping, we map an ERI to any other person's face image to generate more expressive facial expressions.

[1]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[2]  WatersKeith.  A muscle model for animation three-dimensional facial expression , 1987 .

[3]  Paul Wintz,et al.  Digital image processing (2nd ed.) , 1987 .

[4]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[5]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[6]  George Wolberg,et al.  Digital image warping , 1990 .

[7]  WilliamsLance.  Performance-driven facial animation , 1990 .

[8]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[9]  Lance Williams,et al.  Animating images with drawings , 1994, SIGGRAPH.

[10]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[11]  Keith Waters,et al.  Computer facial animation , 1996 .

[12]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[13]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[14]  Steve Marschner,et al.  Inverse Lighting for Photography , 1997, CIC.

[15]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[16]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[17]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[18]  Paul E. Debevec,et al.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 1998, SIGGRAPH '08.

[19]  Arne Stoschek,et al.  Image-based re-rendering of faces for continuous pose and illumination directions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Steve Marschner,et al.  Modeling and Rendering for Realistic Facial Animation , 2000, Rendering Techniques.

[21]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[22]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..