Pose-variant facial expression recognition using an embedded image system

In recent years, one of the most attractive research areas in human-robot interaction is automated facial expression recognition. Through recognizing the facial expression, a pet robot can interact with human in a more natural manner. In this study, we focus on the facial pose-variant problem. A novel method is proposed in this paper to recognize pose-variant facial expressions. After locating the face position in an image frame, the active appearance model (AAM) is applied to track facial features. Fourteen feature points are extracted to represent the variation of facial expressions. The distance between feature points are defined as the feature values. These feature values are sent to a support vector machine (SVM) for facial expression determination. The pose-variant facial expression is classified into happiness, neutral, sadness, surprise or anger. Furthermore, in order to evaluate the performance for practical applications, this study also built a low resolution database (160x120 pixels) using a CMOS image sensor. Experimental results show that the recognition rate is 84% with the self-built database.

[1]  Ioannis Pitas,et al.  ICA and Gabor representation for facial expression recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[2]  Kai-Tai Song,et al.  Embedded CMOS imaging system for real-time robotic vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Yoichi Sato,et al.  Pose-Invariant Facial Expression Recognition Using Variable-Intensity Templates , 2007, International Journal of Computer Vision.

[4]  Masahiro Fujita,et al.  On activating human communications with pet-type robot AIBO , 2004, Proceedings of the IEEE.

[5]  Benzai Deng,et al.  Facial Expression Recognition using AAM and Local Facial Features , 2007, Third International Conference on Natural Computation (ICNC 2007).

[6]  Hadi Seyedarabi,et al.  Recognition of six basic facial expressions by feature-points tracking using RBF neural network and fuzzy inference system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[7]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[8]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[9]  Horst-Michael Groß,et al.  Statistical and neural methods for vision-based analysis of facial expressions and gender , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[10]  Zheru Chi,et al.  Extraction of face image edges with application to expression analysis , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[11]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[12]  Yongzhao Zhan,et al.  Facial expression features extraction based on Gabor wavelet transformation , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).