GLCM features and fuzzy nearest neighbor classifier for emotion recognition from face

An emotion recognition method from the face images is proposed in this paper, which can recognize seven emotions of human, i.e., six basic expressions in addition to neutral. The proposed method uses the GLCM approach for feature extraction and the nearest neighbor (NN) for classification. The fuzzy Euclidean distance is used. GLCM provides the texture characteristics of an input image through the second order statistical measurements. Because of existence of vagueness and uncertainty in the discriminant features extracted from different emotional face images, the fuzzy measure is involved in the NN classifier to recognize the emotions of faces with more accuracy. The experiments show the good efficiency of the introduced recognition method compared to some other feature extraction and facial emotion recognition methods.

[1]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[2]  Gholam Ali Montazer,et al.  A fuzzy-evidential hybrid inference engine for coronary heart disease risk assessment , 2010, Expert Syst. Appl..

[3]  Maryam Imani,et al.  Binary coding based feature extraction in remote sensing high dimensional data , 2016, Inf. Sci..

[4]  Yong Man Ro,et al.  Partial Matching of Facial Expression Sequence Using Over-Complete Transition Dictionary for Emotion Recognition , 2016, IEEE Transactions on Affective Computing.

[5]  Raul Queiroz Feitosa,et al.  Assessment of Binary Coding Techniques for Texture Characterization in Remote Sensing Imagery , 2013, IEEE Geoscience and Remote Sensing Letters.

[6]  Hamed Qahri Saremi,et al.  A neuro-fuzzy inference engine for Farsi numeral characters recognition , 2010, Expert Syst. Appl..

[7]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  P. Kuchi,et al.  1 FACIAL EXPRESSION RECOGNITION USING ARTIFICIAL NEURAL NETWORKS , 2002 .

[9]  H. Ghassemian,et al.  Feature extraction of hyperspectral images using boundary semi-labeled samples and hybrid criterion , 2017 .

[10]  Xuelong Li,et al.  Generalised nearest feature line for subspace learning , 2007 .

[11]  Ioannis A. Kakadiaris,et al.  Automatic 2.5-D Facial Landmarking and Emotion Annotation for Social Interaction Assistance , 2016, IEEE Transactions on Cybernetics.

[12]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[13]  H. Ghassemian,et al.  Local histogram and discriminative learning-based hyperspectral data classification , 2017 .

[14]  Aleksandra Pizurica,et al.  Classification of Hyperspectral Data Over Urban Areas Using Directional Morphological Profiles and Semi-Supervised Feature Extraction , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Jun Li,et al.  Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning , 2015, IEEE Transactions on Image Processing.

[16]  Hassan Ghassemian,et al.  Using GLCM and Gabor filters for classification of PAN images , 2013, 2013 21st Iranian Conference on Electrical Engineering (ICEE).

[17]  William E. Higgins,et al.  Efficient Gabor filter design for texture segmentation , 1996, Pattern Recognit..

[18]  Giancarlo Fortino,et al.  Facial Expression Recognition Utilizing Local Direction-Based Robust Features and Deep Belief Network , 2017, IEEE Access.

[19]  Huimin Lu,et al.  Facial Emotion Recognition Based on Biorthogonal Wavelet Entropy, Fuzzy Support Vector Machine, and Stratified Cross Validation , 2016, IEEE Access.

[20]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[21]  이상완,et al.  Facial Emotional Expression Recognition with Soft Computing Techniques , 2004 .

[22]  Xinwang Liu,et al.  Interval-valued intuitionistic fuzzy aggregation operators , 2012 .

[23]  Qingquan Li,et al.  Gabor Cube Selection Based Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[25]  G. Foody.  Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[26]  Amit Konar,et al.  Emotion Recognition From Facial Expressions and Its Control Using Fuzzy Logic , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Fuan Tsai,et al.  Feature Extraction of Hyperspectral Image Cubes Using Three-Dimensional Gray-Level Cooccurrence , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[28]  B SamirKumar,et al.  A Method for Face Recognition from Facial Expression , 2015 .

[29]  Xin Zhou,et al.  Image enhancement based on intuitionistic fuzzy sets theory , 2016, IET Image Process..