Fuzzy-C-Mean Determines the Principle Component Pairs to Estimate the Degree of Emotion from Facial Expressions

Although many systems exist for automatic classification of faces according to their emotional expression, these systems do not explicitly estimate the strength of given expressions. This paper describes and empirically evaluates an algorithm capable of estimating the degree to which a face expresses a given emotion. The system first aligns and normalizes an input face image, then applies a filter bank of Gabor wavelets and reduces the data's dimensionality via principal components analysis. Finally, an unsupervised Fuzzy-C-Mean clustering algorithm is employed recursively on the same set of data to find the best pair of principle components from the amount of alignment of the cluster centers on a straight line. The cluster memberships are then mapped to degrees of a facial expression (i.e. less Happy, moderately happy, and very happy). In a test on 54 previously unseen happy faces., we find an orderly mapping of faces to clusters as the subject's face moves from a neutral to very happy emotional display. Similar results are observed on 78 previously unseen surprised faces.

[1]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[2]  Richard C. Dubes,et al.  Cluster Analysis and Related Issues , 1993, Handbook of Pattern Recognition and Computer Vision.

[3]  Chanathip Namprempre,et al.  Mitigating Dictionary Attacks with Text-Graphics Character Captchas , 2007, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[4]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[5]  N. Dailey.  Face Detection for Improved Security at Parking Lot Checkpoints , .

[6]  Stanislav S. Makhanov,et al.  A Family of Quadratic Snakes for Road Extraction , 2007, Asian Conference on Computer Vision.

[7]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  J. C. Peters,et al.  Fuzzy Cluster Analysis : A New Method to Predict Future Cardiac Events in Patients With Positive Stress Tests , 1998 .

[9]  Garrison W. Cottrell,et al.  Cultural Differences in Facial Expression Classification , 2007 .

[10]  Peter Haddawy,et al.  Anatomical Sketch Understanding: Recognizing Explicit and Implicit Structure , 2005, AIME.

[11]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Erik Altman,et al.  Program Committee , 2004, Evolvable Hardware.

[13]  L. F. Pau,et al.  Handbook of pattern recognition & computer vision , 1993 .

[14]  Kenneth G. Manton,et al.  Fuzzy Cluster Analysis , 2005 .

[15]  Alan F. Murray,et al.  International Joint Conference on Neural Networks , 1993 .

[16]  M. Dailey,et al.  SLAM WITH KLT POINT FEATURES , 2007 .

[17]  Matthew N. Dailey,et al.  Simultaneous Localization and Mapping with Stereo Vision , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[18]  Garrison W. Cottrell,et al.  Facial Memory Is Kernel Density Estimation (Almost) , 1998, NIPS.

[19]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[20]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[21]  M. Yachida,et al.  Facial expression recognition and its degree estimation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  A. Young,et al.  ARE FACES SPECIAL , 1989 .

[23]  Garrison W. Cottrell,et al.  Task and Spatial Frequency Effects on Face Specialization , 1997, NIPS.

[24]  Bunyarit Uyyanonvara,et al.  Robust hand tracking in low-resolution video sequences , 2007 .

[25]  Maja Pantic,et al.  An Expert System for Recognition of Facial Actions and their Intensity , 2000, AAAI/IAAI.

[26]  William Clouser Boyd,et al.  Fundamentals of Immunology , 1958 .

[27]  Takeaki Uno,et al.  Towards Knowledge-Based Affective Interaction: Situational Interpretation of Affect , 2007, ACII.