Research on Vision-Based Service Robot Oriented Facial Expression Recognition

A facial expression recognition system is developed based on the robot vision to meet the facial expression recognition requirement of service robot's vision-based human- robot interaction. Firstly, the face region is localized based on skin color and Gabor texture. Secondly facial expression features are extracted according to Gabor wavelets transformation and the expression classifier is designed based on support vector machine (SVM), furthermore, seven basic facial expressions are recognized. Finally, Results of experiments show that facial expressions can be real-time classified with high success rate under indoor environment by this system.

[1]  Prabir Bhattacharya,et al.  Classifying facial expressions using point-based analytic face model and Support Vector Machines , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[2]  Wen Gao,et al.  A novel pupil localization method based on GaborEye model and radial symmetry operator , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Wang Houda.  A Method of Human Face Detection in Color Image Using Skin Color Segmentation , 2007 .

[4]  Hiroshi Kobayashi,et al.  Realization of realistic and rich facial expressions by face robot , 2004 .

[5]  Meng Qingmei,et al.  Research and Development of the Humanoid Head Portrait Robot "H&Frobot-II" with Expression and Function of Recognizing Human Expression , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[6]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[7]  Cynthia Breazeal,et al.  Socially intelligent robots: research, development, and applications , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[8]  Léon J. M. Rothkrantz,et al.  Automatic bi-modal emotion recognition system based on fusion of facial expressions and emotion extraction from speech , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[9]  Qiuqi Ruan,et al.  Two-Dimension PCA for Facial Expression Recognition , 2006, 2006 8th international Conference on Signal Processing.

[10]  Ioannis Pitas,et al.  Facial Expression Recognition in Videos using a Novel Multi-Class Support Vector Machines Variant , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[13]  J. Lyons.  Coding facial expression with Gabor wavelets , 1998 .

[14]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[15]  Kazuhiko Yamamoto,et al.  Learning system of human facial expression for a family robot , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[16]  Lin Lu,et al.  Research and Development of the Humanoid Head Portrait Robot "H&Frobot-II" with Expression and Function of Recognizing Human Expression , 2006, ROBIO.

[17]  Can Tong,et al.  Facial Expression Recognition Based on LBP-EHMM , 2008, 2008 Congress on Image and Signal Processing.