FACIAL EXPRESSION CLASSIFICATION WITH HAAR FEATURES, GEOMETRIC FEATURES AND CUBIC BÉZIER CURVES

Facial expressions are nonverbal communication channels to interact with other people.  Computer recognition of human emotions based on facial expression is  an interesting and difficult problem. In this study, images were analyzed based on facial expressions and tried to identify different emotions, such as smile, surprise, sadness, fear, disgust, anger and  neutral. In practice, it was used Viola-Jones face detector  used  AdaBoost  algorithm for  finding the location of the face. Haar filters were used in finding the eyes and mouth. In cases where erroneous detection of the mouth and eyes, facial geometric ratios were used. Cubic BA© zier curves were used in determining emotion. FEEDTUM facial expression database were used for training and testing. The seven different emotions used for the study, the recognition success rates ranged from 97%  to 60%.

[1]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[2]  P. Visutsak.  Emotion Classification using Adaptive SVMs , 2012 .

[3]  A. Rogier.  [Communication without words]. , 1971, Tijdschrift voor ziekenverpleging.

[4]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[5]  Tsuhan Chen,et al.  The painful face - Pain expression recognition using active appearance models , 2009, Image Vis. Comput..

[6]  Khashayar Khorasani,et al.  Facial expression recognition using constructive feedforward neural networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Yuxiao Hu,et al.  Spontaneous Emotional Facial Expression Detection , 2006, J. Multim..

[8]  Mohammad Ibrahim Khan,et al.  Facial Features Approximation for Expression Detection in Human-Robot Interface , 2010, 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[9]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[10]  P. Ekman,et al.  Facial Expression in Affective Disorders , 2005 .

[11]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[12]  Takeo Kanade,et al.  Feature-point tracking by optical flow discriminates subtle differences in facial expression , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[13]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[14]  M. Cranach,et al.  Human Ethology: Claims and Limits of a New Discipline. , 1982 .

[15]  Gwen Littlewort,et al.  Automatic Recognition of Facial Actions in Spontaneous Expressions , 2006, J. Multim..

[16]  Gwen Littlewort,et al.  Automated drowsiness detection for improved driving safety , 2008 .

[17]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[19]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[20]  Bo Wu,et al.  Real time facial expression recognition with AdaBoost , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[21]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[22]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[23]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Gary Faigin,et al.  The Artistʼs Complete Guide to Facial Expression , 1990 .

[25]  Gwen Littlewort,et al.  Towards Social Robots: Automatic Evaluation of Human-robot Interaction by Face Detection and Expression Classification , 2003, NIPS.

[26]  Shalini Bhatia,et al.  Facial Expression Recognition , 2010 .

[27]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Nicu Sebe,et al.  Learning Bayesian network classifiers for facial expression recognition both labeled and unlabeled data , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[29]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[30]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Myung Jin Chung,et al.  Efficient rectangle feature extraction for real-time facial expression recognition based on AdaBoost , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.