Feature fusion of HOG and WLD for facial expression recognition

A considerable amount of research work has been done for facial expression recognition using local or global feature extraction methods. Weber Local Descriptor (WLD), a simple and robust local image descriptor, is recently developed for local feature extraction. In facial expression recognition, the information contained in the local is important for the recognition result. The Histograms of Oriented Gradients (HOG) can well describe the local area information using gradient and orientation density distribution of the edge. In order to solve the lack of contour and shape information only by WLD features and to extract facial local features more efficiently, we propose a hybrid approach that combines the WLD with HOG features. We divide the images into blocks and weight each of them, then extract the two features and fuse them. At last, the weighted fused histograms are used to classify facial expressions by chi-square distance and the nearest neighbor method. The proposed method is applied on popular JAFFE and Cohn-Kanade facial expression databases and recognition rate is up to 93.97% and 95.86%. Compared with the Gabor Wavelet, LBP, and AAM and experimental results show that the proposed method achieves better performance for facial expression recognition.

[1]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[5]  Uwe Handmann,et al.  AAM based continuous facial expression recognition for face image sequences , 2011, 2011 IEEE 12th International Symposium on Computational Intelligence and Informatics (CINTI).

[6]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[8]  Liming Chen,et al.  A novel geometric facial representation based on multi-scale extended local binary patterns , 2011, Face and Gesture 2011.

[9]  Hazim Kemal Ekenel,et al.  Facial action unit detection using kernel partial least squares , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[10]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[11]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[12]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[13]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Daijin Kim,et al.  Natural facial expression recognition using differential-AAM and manifold learning , 2009, Pattern Recognit..

[15]  Jun Ou,et al.  Automatic Facial Expression Recognition Using Gabor Filter and Expression Analysis , 2010, 2010 Second International Conference on Computer Modeling and Simulation.

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Bir Bhanu,et al.  Facial expression recognition using emotion avatar image , 2011, Face and Gesture 2011.

[18]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Qingshan Liu,et al.  Recognizing expressions from face and body gesture by temporal normalized motion and appearance features , 2011, CVPR 2011 WORKSHOPS.

[20]  Li Zhuo,et al.  Learning realistic facial expressions from web images , 2013, Pattern Recognit..

[21]  Antonio Albiol,et al.  Face recognition using HOG-EBGM , 2008, Pattern Recognit. Lett..