An Approach of Extracting Facial Components for Facial Expression Detection using Fiducial Point Detection

Expression detection or Emotion Recognition is one of the rising fields of research on intelligent systems. Emotion plays a significant role in non-verbal communication. An efficient face and facial feature detection algorithms are required to detect emotion at that particular moment. The paperpresents a new approach to the problem of extracting the facial components from a still facial image which will be used further for Facial Expression detection. Robust extraction of such facial feature locations is a crucial problem which is used in a wide range of applications. Facial features such as lip corners, eye corners and nose tip are critical points in a human face. Thepaper approach relies on image segmentation based on skin color algorithm and fiducial point detection. First, the face region is extracted from the image by skin-color filter and window growing. Second, eyes and mouth are approximately located by projection of fiducial point. It is been observed for subjects not wearing glasses, the extraction of eyes could be correctly located in 94% of the images and in over 90% of these images they could be accurately extracted, while for subjects wearing glasses, the success rate is somewhat lower. Also, in certain moods or depending on the facial expression, the detection of lips in case of mouth opening and closing varies which can also be extracted by our method. Keywordsextraction, fiducial point, facial expression.

[1]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Shaogang Gong,et al.  Support vector machine based multi-view face detection and recognition , 2004, Image Vis. Comput..

[3]  Marco Furini,et al.  International Journal of Computer and Applications , 2010 .

[4]  Donald Geman,et al.  Coarse-to-Fine Face Detection , 2004, International Journal of Computer Vision.

[5]  Zhi Liu,et al.  An efficient face segmentation algorithm based on binary partition tree , 2005, Signal Process. Image Commun..

[6]  Maja Pantic,et al.  Fully automatic facial feature point detection using Gabor feature based boosted classifiers , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[7]  Nipun Bhatia,et al.  FIDA : Face Recognition using Descriptive Input Semantics , 2007 .

[8]  Mika Laaksonen,et al.  Adaptive skin color modeling using the skin locus for selecting training pixels , 2003, Pattern Recognit..

[9]  Chengjun Liu,et al.  A Bayesian Discriminating Features Method for Face Detection , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Akinobu Shimizu,et al.  Gradient feature extraction for classification-based face detection , 2003, Pattern Recognit..

[11]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[12]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Mingjing Li,et al.  Robust multipose face detection in images , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Michael G. Strintzis,et al.  Face localization and authentication using color and depth images , 2005, IEEE Transactions on Image Processing.

[15]  A. Murat Tekalp,et al.  Face and 2-D mesh animation in MPEG-4 , 2000, Signal Process. Image Commun..