Dynamic Facial Expression Recognition based on Korder Emotional Intensity Model and Facial Expression Sequences

With the development of artificial intelligence and pattern recognition, facial expression recognition plays a more and more important role in intelligent human-computer interaction. In this paper, we present a model named K-order emotional intensity model (K-EIM) which is based on K-Means clustering. Different from other related works, the proposed approach can quantify emotional intensity in an unsupervised way. And then the output from K-EIM is encoded. The coding results are used for the dynamic facial expression recognition. The experiment is conducted on Cohn-Kanade facial expression database and the support vector machine classifier is used for facial expression classification. This method achieved a dynamic facial expression recognition accuracy of 88.32% which suggest that the proposed method shows better performance and proves its validity. Moreover, effect of different segments of emotional intensity is also discussed in the paper.

[1]  Zhang Youwei,et al.  Facial expression recognition based on motion information between frames , 2006 .

[2]  R. Borgatti,et al.  The Development of Dynamic Facial Expression Recognition at Different Intensities in 4- to 18-Year-Olds , 2010 .

[3]  P SumathiC.,et al.  Automatic Facial Expression Analysis A Survey , 2012 .

[4]  Aleksandra Kostić,et al.  The accuracy of intensity ratings of emotions from facial expressions , 2003 .

[5]  Gabriella Bottini,et al.  Ambiguous emotion recognition in temporal lobe epilepsy: The role of expression intensity , 2013, Cognitive, Affective, & Behavioral Neuroscience.

[6]  Benzai Deng,et al.  Facial Expression Recognition using AAM and Local Facial Features , 2007, Third International Conference on Natural Computation (ICNC 2007).

[7]  B. Moore.  Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[8]  Stephen Lehmann,et al.  The Science of Happiness: How Our Brains Make Us Happy-and What We Can Do to Get Happier , 2006 .

[9]  U. Hess,et al.  The Intensity of Emotional Facial Expressions and Decoding Accuracy , 1997 .

[10]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[11]  Changqin Quan,et al.  A new preprocessing algorithm and local binary pattern based facial expression recognition , 2013, Proceedings of the 2013 IEEE/SICE International Symposium on System Integration.

[12]  Yu Jun,et al.  Algorithms for Facial Expression Action Tracking and Facial Expression Recognition , 2011 .

[13]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[14]  Luo Da-yong.  An expressional dynamic feature extraction method based on Gabor filtering , 2012 .

[15]  Stefanie Rukavina,et al.  Expression intensity, gender and facial emotion recognition: Women recognize only subtle facial emotions better than men. , 2010, Acta psychologica.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[18]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[20]  Alex Pentland,et al.  Facial expression recognition using a dynamic model and motion energy , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[22]  Cezary Biele,et al.  Sex differences in perception of emotion intensity in dynamic and static facial expressions , 2006, Experimental Brain Research.

[23]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[24]  Bernhard Fröba,et al.  Boosting a Haar-Like Feature Set for Face Verification , 2003, AVBPA.

[25]  N. Ridout,et al.  The influence of emotional intensity on facial emotion recognition in disordered eating , 2012, Appetite.

[26]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[29]  Guillermo Recio,et al.  Recognizing dynamic facial expressions of emotion: Specificity and intensity effects in event-related brain potentials , 2014, Biological Psychology.

[30]  Michael J. Black,et al.  Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion , 1997, International Journal of Computer Vision.

[31]  P. Ekman,et al.  Pan-Cultural Elements in Facial Displays of Emotion , 1969, Science.

[32]  R. Larsen,et al.  Theory and measurement of affect intensity as an individual difference characteristic. , 1984 .

[33]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[34]  R. Larsen,et al.  Affect intensity as an individual difference characteristic: A review , 1987 .