Reanimating Faces in Images and Video

This paper presents a method for photo‐realistic animation that can be applied to any face shown in a single imageor a video. The technique does not require example data of the person's mouth movements, and the image to beanimated is not restricted in pose or illumination. Video reanimation allows for head rotations and speech in theoriginal sequence, but neither of these motions is required.

[1]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[2]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[3]  Jun-yong Noh,et al.  Expression cloning , 2001, SIGGRAPH.

[4]  Peter Eisert,et al.  Speech Driven Synthesis of Talking Head Sequences , 1997 .

[5]  Tony Ezzat,et al.  Trainable videorealistic speech animation , 2002, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[6]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[7]  Dimitris N. Metaxas,et al.  Optical Flow Constraints on Deformable Models with Applications to Face Tracking , 2000, International Journal of Computer Vision.

[8]  Irfan Essa,et al.  Visual Coding and Tracking of Speech Related Facial Motion , 2001, CVPR 2001.

[9]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[10]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[11]  Frederick I. Parke,et al.  Computer gernerated animation of faces , 1998 .

[12]  Tony Ezzat,et al.  Face analysis for the synthesis of photo-realistic talking heads , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[13]  David Salesin,et al.  Modeling and Animating Realistic Faces from Images , 2002, International Journal of Computer Vision.

[14]  Tony Ezzat,et al.  Visual Speech Synthesis by Morphing Visemes , 2000, International Journal of Computer Vision.

[15]  Matthew Brand,et al.  Voice puppetry , 1999, SIGGRAPH.

[16]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[17]  Christoph Bregler,et al.  Video Rewrite: Driving Visual Speech with Audio , 1997, SIGGRAPH.

[18]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Thomas S. Huang,et al.  3-D Face Modeling and Its Applications , 1996, Int. J. Pattern Recognit. Artif. Intell..

[20]  Mei-Yuh Hwang,et al.  The SPHINX-II speech recognition system: an overview , 1993, Comput. Speech Lang..

[21]  N. Magnenat-Thalmann,et al.  Automatic face cloning and animation using real-time facial feature tracking and speech acquisition , 2001, IEEE Signal Process. Mag..

[22]  SzeliskiRichard,et al.  Modeling and Animating Realistic Faces from Images , 2002 .

[23]  Markus H. Gross,et al.  Emotion Editing using Finite Elements , 1998, Comput. Graph. Forum.

[24]  Luc Van Gool,et al.  Face animation based on observed 3D speech dynamics , 2001, Proceedings Computer Animation 2001. Fourteenth Conference on Computer Animation (Cat. No.01TH8596).

[25]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[26]  Pascal Fua,et al.  Animated Heads from Ordinary Images: A Least-Squares Approach , 1999, Comput. Vis. Image Underst..

[27]  Juan Pineda,et al.  A parallel algorithm for polygon rasterization , 1988, SIGGRAPH.

[28]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[29]  Thomas Vetter,et al.  Estimating Coloured 3D Face Models from Single Images: An Example Based Approach , 1998, ECCV.

[30]  David G. Stork,et al.  Pattern Classification , 1973 .

[31]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[32]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[33]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[34]  Frederic I. Parke,et al.  A parametric model for human faces. , 1974 .

[35]  Radek Grzeszczuk,et al.  A data-driven model for monocular face tracking , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.