Facial Expression Classification through Covariance Matrix Correlations

This paper attempts to classify known facial expressions and to establish the correlations between two regions (eye + eyebrows and mouth) in identifying the six prototypic expressions. Covariance is used to describe region texture that captures facial features for classification. The texture captured exhibit the pattern observed during the execution of particular expressions. Feature matching is done by simple distance measure between the probe and the modeled representations of eye and mouth components. We target JAFFE database in this experiment to validate our claim. A high classification rate is observed from the mouth component and the correlation between the two (eye and mouth) components. Eye component exhibits a lower classification rate if used independently.

[1]  Timothy F. Cootes,et al.  Interpreting face images using active appearance models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[2]  Kyeong Hur,et al.  RIO-DC Buffer Design for Core Routers in DiffServ Assured Services , 2011, J. Inform. and Commun. Convergence Engineering.

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Kyeong Hur Modified BLUE Packet Buffer for Base-Stations in Mobile IP-based Networks , 2011, J. Inform. and Commun. Convergence Engineering.

[5]  Chi Chung Ko,et al.  Using moment invariants and HMM in facial expression recognition , 2002, Pattern Recognit. Lett..

[6]  Jun Zhang,et al.  Pace recognition: eigenface, elastic matching, and neural nets , 1997, Proc. IEEE.

[7]  Aziz Umit Batur,et al.  Adaptive active appearance models , 2005, IEEE Transactions on Image Processing.

[8]  Penio S. Penev,et al.  Local feature analysis: A general statistical theory for object representation , 1996 .

[9]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Junchul Chun,et al.  Classification of Facial Expression Using SVM for Emotion Care Service System , 2008, 2008 Ninth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing.

[11]  Thomas S. Huang,et al.  Facial expression recognition: A clustering-based approach , 2003, Pattern Recognit. Lett..

[12]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[13]  Geum-Boon Lee,et al.  Facial component features for facial expression identification using Active Appearance Models , 2009, AFRICON 2009.

[14]  Beom-Joon Cho,et al.  Global Feature Extraction and Recognition from Matrices of Gabor Feature Faces , 2011, J. Inform. and Commun. Convergence Engineering.

[15]  Guangyou Xu,et al.  Face detection based on template matching and support vector machines , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[16]  W. Förstner,et al.  A Metric for Covariance Matrices , 2003 .

[17]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.