3D Facial expression synthesis: A survey

Facial expression synthesis is a process of generating new face shapes from a given face and still retain the distinct facial characteristics of the initial face. The generated facial expressions can be used to improve the performance of existing face identification systems, or to enhance human recognition. Earlier work on synthesizing face shapes used 2D face images. Only recently, the work moved to using 3D face shapes given the availability and improvement in 3D scanner technologies. The advantage of 3D faces over 2D image data is that 3D face holds more geometric shape data and is invariant to poses and illumination. This paper aims to give an overview of the methods used for 3D facial expression synthesis. We present an overview of 3D face expression synthesis, its applications and benefits and then we review some of the most resent 3D face expression synthesis approaches.

[1]  J.-L. Minoi,et al.  Synthesizing Realistic Expressions in 3D Face Data Sets , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[2]  Daniel Thalmann,et al.  A plastic-visco-elastic model for wrinkles in facial animation and skin aging , 1994 .

[3]  Linghua Li,et al.  A Survey of Computer Facial Animation Techniques , 2012, 2012 International Conference on Computer Science and Electronics Engineering.

[4]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[5]  Bruce A. Draper,et al.  A Statistical Assessment of Subject Factors in the PCA Recognition of Human Faces , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[6]  Prem Kalra,et al.  MODEL BASED FACE RECONSTRUCTION FOR ANIMATION , 1999 .

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  Norman I. Badler,et al.  Animating facial expressions , 1981, SIGGRAPH '81.

[9]  Shigeo Morishima,et al.  Physics-based muscle model for mouth shape control , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[10]  Ioannis Pitas,et al.  Facial expression analysis and synthesis : A survey , 2003 .

[11]  Xiaoou Tang,et al.  Automatic facial expression recognition on a single 3D face by exploring shape deformation , 2009, ACM Multimedia.

[12]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[13]  D. Zhang,et al.  Principle Component Analysis , 2004 .

[14]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David R. Forsey,et al.  Langwidere: a new facial animation system , 1994, Proceedings of Computer Animation '94.

[16]  Narendra Patel,et al.  3D Facial model construction and expressions synthesis from a single frontal face image , 2010, 2010 International Conference on Computer and Communication Technology (ICCCT).

[17]  Sung Yong Shin,et al.  An example-based approach for facial expression cloning , 2003, SCA '03.

[18]  TerzopoulosDemetri,et al.  Geometry-Driven Photorealistic Facial Expression Synthesis , 2006 .

[19]  Daniel Thalmann,et al.  Simulation of Facial Muscle Actions Based on Rational Free Form Deformations , 1992, Comput. Graph. Forum.

[20]  Hans-Peter Seidel,et al.  Geometry-based Muscle Modeling for Facial Animation , 2001, Graphics Interface.

[21]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[22]  Yanxi Liu,et al.  A quantified study of facial asymmetry in 3D faces , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[23]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[24]  Stephen Michael Platt,et al.  A structural model of the human face (graphics, animation, object representation) , 1985 .

[25]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[26]  Jacey-Lynn Minoi.  Geometric expression invariant 3D face recognition using statistical discriminant models , 2009 .

[27]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[28]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[29]  Carlos E. Thomaz,et al.  A Statistical Discriminant Model for Face Interpretation and Reconstruction , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[30]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[31]  Ken-ichi Anjyo,et al.  Bilinear interpolation for facial expression and metamorphosis in real-time animation , 2005, The Visual Computer.

[32]  Sabine Coquillart,et al.  Extended free-form deformation: a sculpturing tool for 3D geometric modeling , 1990, SIGGRAPH.

[33]  Carlos E. Thomaz,et al.  Maximum entropy covariance estimate for statistical pattern recognition , 2004 .

[34]  Anil K. Jain,et al.  Multimodal Facial Gender and Ethnicity Identification , 2006, ICB.

[35]  Pierre Poulin,et al.  Real-time facial animation based upon a bank of 3D facial expressions , 1998, Proceedings Computer Animation '98 (Cat. No.98EX169).

[36]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[37]  Lei Zhang,et al.  Realistic Real-time Facial Expressions Animation via 3D Morphing Target , 2013, J. Softw..

[38]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[39]  Nadia Magnenat-Thalmann,et al.  MPEG-4 based animation with face feature tracking , 1999, Computer Animation and Simulation.

[40]  Zhaohui Wu,et al.  Removal of 3D facial expressions: A learning-based approach , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.