Diverse videos synthesis using manifold-based parametric motion model for facial understanding

Personal style is the cause of interpersonal variations, which play an important role in facial expression recognition. In this study, a model has been proposed to generate diverse sequences of virtual samples for a new subject. These sequences are thought to enrich the training set in order to increase robustness of recognition with respect to individual variations and improve generalisation to the new person. In the manifold-based parametric motion model, the trajectory of the source person has been used to estimate and conduct the virtual facial expression vectors of the target person. In the recognition experiments, images are represented in the lower-dimensional feature space, whereas the virtual vectors are generated in the feature space. The accuracy of the independent system shows the effectiveness of samples in improving the performance of the system based on the limited data of the new person. The accuracy of seven expressions is 90.65%, which is an improvement over the baseline model, which is 86.11%, and represents a significant (P < 0.05) improvement over the baseline method, which is 83.4%.

[1]  Oksam Chae,et al.  Robust Facial Expression Recognition Based on Local Directional Pattern , 2010 .

[2]  Lionel Prevost,et al.  Impact of action unit detection in automatic emotion recognition , 2012, Pattern Analysis and Applications.

[3]  Ahmed M. Elgammal,et al.  Homeomorphic Manifold Analysis (HMA): Generalized separation of style and content on manifolds , 2013, Image Vis. Comput..

[4]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[5]  Hassan Aghaeinia,et al.  Video-based facial expression recognition by removing the style variations , 2015, IET Image Process..

[6]  Jan J. Gerbrands,et al.  On the relationships between SVD, KLT and PCA , 1981, Pattern Recognit..

[7]  Tomaso Poggio,et al.  Incorporating prior information in machine learning by creating virtual examples , 1998, Proc. IEEE.

[8]  Peter H. Tu,et al.  Learning person-specific models for facial expression and action unit recognition , 2013, Pattern Recognit. Lett..

[9]  Dimitrios Hatzinakos,et al.  Projection into Expression Subspaces for Face Recognition from Single Sample per Person , 2013, IEEE Transactions on Affective Computing.

[10]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[11]  Zahir M. Hussain,et al.  Automatic facial expression recognition: feature extraction and selection , 2010, Signal, Image and Video Processing.

[12]  Anastasios Tefas,et al.  Improving subspace learning for facial expression recognition using person dependent and geometrically enriched training sets , 2011, Neural Networks.

[13]  Hans-Peter Seidel,et al.  A Generic Framework for Efficient 2-D and 3-D Facial Expression Analogy , 2007, IEEE Transactions on Multimedia.

[14]  Bing Zhou,et al.  Facial expression cloning with elastic and muscle models , 2014, J. Vis. Commun. Image Represent..

[15]  Hao Li,et al.  Realtime performance-based facial animation , 2011, ACM Trans. Graph..

[16]  Wei Wei,et al.  A realistic dynamic facial expression transfer method , 2012, Neurocomputing.

[17]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Bir Bhanu,et al.  Understanding Discrete Facial Expressions in Video Using an Emotion Avatar Image , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[20]  Steve J. Young,et al.  Cognitive User Interfaces , 2010, IEEE Signal Processing Magazine.

[21]  Stefanos Zafeiriou,et al.  Recognition of 3D facial expression dynamics , 2012, Image Vis. Comput..

[22]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[24]  Sridha Sridharan,et al.  Automatically Detecting Pain in Video Through Facial Action Units , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Robert Sabourin,et al.  Evaluation of incremental learning algorithms for HMM in the recognition of alphanumeric characters , 2009, Pattern Recognit..

[26]  Nizar Bouguila,et al.  Novel approaches for synthesizing video textures , 2012, Expert Syst. Appl..

[27]  Ken-ichi Anjyo,et al.  Spacetime expression cloning for blendshapes , 2012, TOGS.