Recognizing Human Emotion from Partial Facial Features

Recognizing human emotions from partial facial features is quite hard to achieve reasonable accuracy. In this paper, we propose to use a tree structure representation to simulate as human perceiving the real human face and both the entities and relationship could contribute to the facial expression features. Moreover, a new structural connectionist architecture based on a probabilistic approach to adaptive processing of data structures is presented to generalize the FacE emotion tree structures (FEETS). We demonstrated the robustness of our proposed system in recognizing the correct emotion based on partial face features. The system yields an accuracy of about 90% for subjects with partial face covered by artifacts.

[1]  Siu-Yeung Cho,et al.  Probabilistic Based Recursive Model for Face Recognition , 2005, FSKD.

[2]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[3]  T. Dalgleish,et al.  Handbook of cognition and emotion , 1999 .

[4]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Volker Blanz,et al.  Component-Based Face Recognition with 3D Morphable Models , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[6]  Tommy W. S. Chow,et al.  Training multilayer neural networks using fast global learning algorithm - least-squares and penalized optimization methods , 1999, Neurocomputing.

[7]  Stephen J. Roberts,et al.  A Probabilistic Resource Allocating Network for Novelty Detection , 1994, Neural Computation.

[8]  Sun-Yuan Kung,et al.  Decision-based neural networks with signal/image classification applications , 1995, IEEE Trans. Neural Networks.

[9]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[10]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Larry S. Davis,et al.  Human expression recognition from motion using a radial basis function network architecture , 1996, IEEE Trans. Neural Networks.

[12]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Roy L. Streit,et al.  Maximum likelihood training of probabilistic neural networks , 1994, IEEE Trans. Neural Networks.

[15]  J. Thompson.  Development of facial expression of emotion in blind and seeing children. , 1941 .

[16]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[17]  Ah Chung Tsoi,et al.  An improved algorithm for learning long-term dependency problems in adaptive processing of data structures , 2003, IEEE Trans. Neural Networks.

[18]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Ah Chung Tsoi,et al.  Adaptive processing of data structures , 1999, Proceedings Third International Conference on Computational Intelligence and Multimedia Applications. ICCIMA'99 (Cat. No.PR00300).