Facial Expression Recognition Using Adaptive Neuro-fuzzy Inference Systems

Facial expressions form a universal language of emotions, which can instantly express a wide range of emotional states and feelings. The analysis of facial expressions and the accurate recognition of their emotional content are highly desired and assistive in a wide spectrum of domains. In this paper, we present a work on the analysis of facial expressions and the recognition of emotions using an approach that is based on adaptive neuro fuzzy inference systems. Initially, given a new image, human faces are detected using the Viola-Jones algorithm. Then, facial expressions are analyzed and facial deformations of specific regions such as eyes, eyebrows and mouth are located and then characteristics such as locations, length, width and shape are extracted. The feature vectors represent the deformations of the facial expression and based on them the emotional content of the facial expressions is recognized using an approach that is based on adaptive neuro fuzzy inference systems. An evaluation study was conducted on the JAFFE database and the results collected were very encouraging indicating that the approach is efficient and accurate in analyzing facial expressions and recognizing their emotional content.

[1]  Nyein Aye,et al.  A Facial Expression Classification using Histogram Based Method , .

[2]  Mohammad H. Mahoor,et al.  Going deeper in facial expression recognition using deep neural networks , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[3]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[4]  A. Rogier.  [Communication without words]. , 1971, Tijdschrift voor ziekenverpleging.

[5]  Kah Phooi Seng,et al.  Facial Emotion Recognition for Intelligent Tutoring Environment , 2022 .

[6]  Dimitrios I. Fotiadis,et al.  An automatic region based methodology for facial expression recognition , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[7]  P. Campadelli,et al.  AN AUTOMATIC FEATURE-BASED FACE RECOGNITION SYSTEM , 2004 .

[8]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Andrea Cavallaro,et al.  Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ioannis Hatzilygeroudis,et al.  Deep Learning Approaches for Facial Emotion Recognition: A Case Study on FER-2013 , 2018 .

[12]  Catalin-Daniel Caleanu.  Face expression recognition: A brief overview of the last decade , 2013, 2013 IEEE 8th International Symposium on Applied Computational Intelligence and Informatics (SACI).

[13]  Ioannis Hatzilygeroudis,et al.  Recognizing Emotions from Facial Expressions Using Neural Network , 2014, AIAI.

[14]  Mohammad Reza Mohammadi,et al.  PCA-based dictionary building for accurate facial expression recognition via sparse representation , 2014, J. Vis. Commun. Image Represent..

[15]  Minjuan Wang,et al.  Affective e-Learning: Using "Emotional" Data to Improve Learning in Pervasive Learning Environment , 2009, J. Educ. Technol. Soc..

[16]  C. Pelachaud,et al.  Facial Expressions of Emotions for Virtual Characters , 2015 .

[17]  R. S. Jadon,et al.  Recognizing Facial Expressions Using Eigenspaces , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[18]  Samarjit Kar,et al.  Applications of neuro fuzzy systems: A brief review and future outline , 2014, Appl. Soft Comput..

[19]  Ioannis Hatzilygeroudis,et al.  Recognize Emotions from Facial Expressions Using a SVM and Neural Network Schema , 2015, EANN.

[20]  Nobuyuki Otsu,et al.  Facial expression recognition using Fisher weight maps , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[21]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Maja Pantic,et al.  Facial Expression Recognition , 2009, Encyclopedia of Biometrics.

[23]  Yoshua Bengio,et al.  Challenges in representation learning: A report on three machine learning contests , 2013, Neural Networks.

[24]  Radu Tudor Ionescu,et al.  Local Learning to Improve Bag of Visual Words Model for Facial Expression Recognition , 2013 .

[25]  Antonios Danelakis,et al.  A survey on facial expression recognition in 3D video sequences , 2014, Multimedia Tools and Applications.