Incorporating prior knowledge from the new person into recognition of facial expression

Inter-subject variability plays an important role in the performance of facial expression recognition. Therefore, several methods have been developed to bring the performance of a person-independent system closer to that of a person-dependent one. These techniques need different samples from a new person to increase the generalization ability. We have proposed a new approach to address this problem. It employs the person’s neutral samples as prior knowledge and a synthesis method based on the subspace learning to generate virtual expression samples. These samples have been incorporated in learning process to learn the style of the new person. We have also enriched the training data set by virtual samples created for each person in this set. Compared with previous studies, the results showed that our approach can perform the task of facial expression recognition effectively with better robustness for corrupted data.

[1]  Philip C. Woodland,et al.  Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models , 1995, Comput. Speech Lang..

[2]  Tomaso Poggio,et al.  Incorporating prior information in machine learning by creating virtual examples , 1998, Proc. IEEE.

[3]  Roland Kuhn,et al.  Rapid speaker adaptation in eigenvoice space , 2000, IEEE Trans. Speech Audio Process..

[4]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[5]  Qiang Ji,et al.  Active and dynamic information fusion for facial expression understanding from image sequences , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Gwen Littlewort,et al.  Fully Automatic Facial Action Recognition in Spontaneous Behavior , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[7]  Kumar Chellapilla,et al.  Personalized handwriting recognition via biased regularization , 2006, ICML.

[8]  Ashok Samal,et al.  Computation of a face attractiveness index based on neoclassical canons, symmetry, and golden ratios , 2008, Pattern Recognit..

[9]  Robert Sabourin,et al.  Evaluation of incremental learning algorithms for HMM in the recognition of alphanumeric characters , 2009, Pattern Recognit..

[10]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[11]  Oksam Chae,et al.  Robust Facial Expression Recognition Based on Local Directional Pattern , 2010 .

[12]  Dimitrios Hatzinakos,et al.  An expression transformation for improving the recognition of expression-variant faces from one sample image per person , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[13]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[14]  Fadi Dornaika,et al.  Improving dynamic facial expression recognition with feature subset selection , 2011, Pattern Recognit. Lett..

[15]  Anastasios Tefas,et al.  Improving subspace learning for facial expression recognition using person dependent and geometrically enriched training sets , 2011, Neural Networks.

[16]  Cheng-Lin Liu,et al.  Style transfer matrix learning for writer adaptation , 2011, CVPR 2011.

[17]  Lionel Prevost,et al.  Impact of action unit detection in automatic emotion recognition , 2012, Pattern Analysis and Applications.

[18]  Arman Savran,et al.  Comparative evaluation of 3D vs. 2D modality for automatic detection of facial action units , 2012, Pattern Recognit..

[19]  Shiqing Zhang,et al.  Facial expression recognition using local binary patterns and discriminant kernel locally linear embedding , 2012, EURASIP Journal on Advances in Signal Processing.

[20]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[21]  Yi Ji,et al.  Automatic facial expression recognition based on spatiotemporal descriptors , 2012, Pattern Recognit. Lett..

[22]  Dimitrios Hatzinakos,et al.  Projection into Expression Subspaces for Face Recognition from Single Sample per Person , 2013, IEEE Transactions on Affective Computing.

[23]  Hongchuan Yu,et al.  Mean value coordinates–based caricature and expression synthesis , 2013, Signal Image Video Process..

[24]  Cheng-Lin Liu,et al.  Writer Adaptation with Style Transfer Mapping , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Narendra Patel,et al.  3D facial model reconstruction, expressions synthesis and animation using single frontal face image , 2013, Signal Image Video Process..