Emotion Recognition Approach Using Multilayer Perceptron Network and Motion Estimation

Man-machineinteractionisaninterdisciplinaryfieldofresearchthatprovidesnaturalandmultimodal waysofinteractionbetweenhumansandcomputers.Forthispurpose,thecomputermustunderstand theemotionalstateofthepersonwithwhomitinteracts.Thisarticleproposesanovelmethodfor detectingandclassifythebasicemotionslikesadness,joy,anger,fear,disgust,surprise,andinterest thatwasintroducedinpreviousworks.Aswithallemotionrecognitionsystems,theapproachfollows thebasicsteps,suchas:facialdetectionandfacialfeatureextraction.Inthesesteps,thecontributionis expressedbyusingstrategicfacepointsandinterpretsmotionsasactionunitsextractedbytheFACS system.Thesecondcontributionisattheleveloftheclassificationstep,wheretwoclassifierswere used:Kohonenself-organizingmaps(KSOM)andmultilayerperceptron(MLP)inordertoobtain thebestresults.Theobtainedresultsshowthattherecognitionrateofbasicemotionshasimproved, andtherunningtimewasminimizedbyreducingresourceuse. KEywoRdS Action Units, Bloc Matching, Emotion Recognition, Facial Expression, FACS, Interest, Kohonen, MLP, Neural Network

[1]  Nicu Sebe,et al.  Learning Bayesian network classifiers for facial expression recognition both labeled and unlabeled data , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Jian-Jiun Ding,et al.  Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection , 2015, Signal Process..

[3]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  H. Markus,et al.  Culture and the self: Implications for cognition, emotion, and motivation. , 1991 .

[5]  Timothy F. Cootes,et al.  A unified approach to coding and interpreting face images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[6]  Harikishan Shetty,et al.  Neural Network Approach for Classification of Human Emotions from EEG Signal , 2018, Engineering Vibration, Communication and Information Processing.

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  D. Carmelli,et al.  Curiosity and mortality in aging adults: a 5-year follow-up of the Western Collaborative Group Study. , 1996, Psychology and aging.

[9]  Goran Martinović,et al.  Emotion Recognition System by a Neural Network Based Facial Expression Analysis , 2013 .

[10]  Musaed Alhussein.  Automatic facial emotion recognition using weber local descriptor for e-Healthcare system , 2016, Cluster Computing.

[11]  Qiuqi Ruan,et al.  Tensor rank one differential graph preserving analysis for facial expression recognition , 2012, Image Vis. Comput..

[12]  Mahesh Chandra,et al.  Use of Different Features for Emotion Recognition Using MLP Network , 2015 .

[13]  Ioan Marius Bilasco,et al.  Intelligent pixels of interest selection with application to facial expression recognition using multilayer perceptron , 2013, Signal Process..

[14]  Nasrollah Moghaddam Charkari,et al.  Audiovisual emotion recognition using ANOVA feature selection method and multi-classifier neural networks , 2014, Neural Computing and Applications.

[15]  Le Hoang Thai,et al.  Facial Expression Classification Using Artificial Neural Network and K-Nearest Neighbor , 2015 .

[16]  Leontios J. Hadjileontiadis,et al.  Emotion Recognition From EEG Using Higher Order Crossings , 2010, IEEE Transactions on Information Technology in Biomedicine.

[17]  P. Silvia.  Interest and Interests: The Psychology of Constructive Capriciousness , 2001 .

[18]  A. Mehrabian.  Communication without words , 1968 .

[19]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[20]  Roberto Paredes,et al.  Dimensionality reduction by minimizing nearest-neighbor classification error , 2011, Pattern Recognit. Lett..

[21]  Nicu Sebe,et al.  Authentic facial expression analysis , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[22]  C. Izard.  The psychology of emotions , 1991 .

[23]  Franck Davoine,et al.  Facial expression recognition and synthesis based on an appearance model , 2004, Signal Process. Image Commun..

[24]  Mihir Narayan Mohanty,et al.  On the Use of MFCC Feature Vector Clustering for Efficient Text Dependent Speaker Recognition , 2013, FICTA.

[25]  Hui Yu,et al.  Combining appearance and geometric features for facial expression recognition , 2015, International Conference on Graphic and Image Processing.

[26]  Ashim Saha,et al.  A Human Facial Expression Recognition Model Based on Eigen Face Approach , 2015 .

[27]  Belhouchet Kenza,et al.  Facial expressions of interest's emotion , 2015, 2015 International Conference on Applied Research in Computer Science and Engineering (ICAR).

[28]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[29]  Omar Sharif,et al.  A Literature Review on Emotion Recognition Using Various Methods , 2017 .