Moving Facial Image Transformations Based on Static 2D Prototypes

This paper describes a new method for creating visually realistic moving facial image sequences that retain an actor's personality (individuality, expression and characteristic movements) while altering the facial appearance along a certain specified facial dimension. We combine two existing technologies, facial feature tracking and facial image transformation, to create the sequences. Examples are given of transforming the apparent age, race and gender of a face. We also create 'virtual cartoons' by transforming image sequences into the style of famous artists. The results show that static 2D face models can be used to create realistic transformations of sequences that include changes in pose, expression and mouth shape.

[1]  D I Perrett,et al.  Extracting Prototypical Facial Images from Exemplars , 1993, Perception.

[2]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[3]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Tomaso A. Poggio,et al.  A bootstrapping algorithm for learning linear models of object classes , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  B. Tiddeman,et al.  Synthesis and transformation of three-dimensional facial images , 1999, IEEE Engineering in Medicine and Biology Magazine.

[6]  Bernard Tiddeman,et al.  A general method for overlap control in image warping , 2001, Comput. Graph..

[7]  Timothy F. Cootes,et al.  Learning to identify and track faces in image sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[9]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[10]  N. D. Duffy,et al.  Facial image reconstruction and manipulation from measurements obtained using a structured lighting technique , 1988, Pattern Recognit. Lett..

[11]  D. Perrett,et al.  Perception of age in adult Caucasian male faces: computer graphic manipulation of shape and colour information , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  Hiroshi Harashima,et al.  A system of analyzing and synthesizing facial images , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[13]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[14]  David I. Perrett,et al.  Synthesising continuous-tone caricatures , 1991, Image Vis. Comput..

[15]  Alex Pentland,et al.  Modeling, tracking and interactive animation of faces and heads//using input from video , 1996, Proceedings Computer Animation '96.

[16]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[17]  Sung Yong Shin,et al.  Image metamorphosis using snakes and free-form deformations , 1995, SIGGRAPH.

[18]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[19]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[20]  Kiyoharu Aizawa,et al.  Analysis and synthesis of facial image sequences in model-based image coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[21]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..

[24]  Takeo Kanade,et al.  Detection, tracking, and classification of action units in facial expression , 2000, Robotics Auton. Syst..

[25]  Duncan Rowland,et al.  Manipulating facial appearance through shape and color , 1995, IEEE Computer Graphics and Applications.

[26]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[27]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[28]  David C. Hogg,et al.  Generating Spatiotemporal Models from Examples , 1995, BMVC.

[29]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.