Facial emotion recognition using emotional neural network and hybrid of fuzzy c-means and genetic algorithm

Facial emotion recognition (FER) is a critical task for both human-human (HHI) and human-computer interactions (HCl). In this paper, a brain-inspired neural basis computational model of FER is proposed based on emotional neural networks (ENN), fuzzy c-means (FCM) and genetic algorithms (GA). The proposed model can be applied in both HHI and HCI applications. In HHI, it can be used for improving communication skills, and in HCI it can be used in various treatment processes e.g. anxiety treatment, cancer radiation treatment and remote children/elderlies monitoring systems. The proposed model consists of main modules of emotional brain which recognize the facial emotions. In the experimental studies, the proposed model is examined on children's facial sad recognition as a case study. The results show that our model is valid and can be applied for various FER tasks.

[1]  A. Calder.  Facial Emotion Recognition after Bilateral Amygdala Damage: Differentially Severe Impairment of Fear , 1996 .

[2]  S. Baron-Cohen,et al.  Do Adults with High Functioning Autism or Asperger Syndrome Differ in Empathy and Emotion Recognition? , 2016, Journal of Autism and Developmental Disorders.

[3]  E. Leibenluft,et al.  The NIMH Child Emotional Faces Picture Set (NIMH‐ChEFS): a new set of children's facial emotion stimuli , 2011, International journal of methods in psychiatric research.

[4]  J. G. Taylor,et al.  Emotion recognition in human-computer interaction , 2005, Neural Networks.

[5]  G. Cottrell,et al.  Categorical Perception in Facial Emotion Classification , 1996 .

[6]  Luc Van Gool,et al.  Recognizing emotions expressed by body pose: A biologically inspired neural model , 2008, Neural Networks.

[7]  Ehsan Lotfi,et al.  Adaptive brain emotional decayed learning for online prediction of geomagnetic activity indices , 2014, Neurocomputing.

[8]  C. Kohler,et al.  Facial emotion perception in schizophrenia: a meta-analytic review. , 2010, Schizophrenia bulletin.

[9]  Saeid Nahavandi,et al.  Nonlinear programming problem solving based on winner take all emotional neural network for tensegrity structure design , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[10]  Mohamed Hamdy El-Saify,et al.  Brain Emotional Learning Based Intelligent Decoupler for Nonlinear Multi-Input Multi-Output Distillation Columns , 2017 .

[11]  Colin G. Johnson,et al.  A Situation-Aware Fear Learning (SAFEL) model for robots , 2017, Neurocomputing.

[12]  Ehsan Lotfi,et al.  BRAIN EMOTIONAL LEARNING-BASED PATTERN RECOGNIZER , 2013, Cybern. Syst..

[13]  J. Movellan,et al.  Human and computer recognition of facial expressions of emotion , 2007, Neuropsychologia.

[14]  Elina Birmingham,et al.  Are emotion recognition abilities related to everyday social functioning in ASD? A meta-analysis , 2016 .

[15]  Christian Balkenius,et al.  EMOTIONAL LEARNING: A COMPUTATIONAL MODEL OF THE AMYGDALA , 2001, Cybern. Syst..

[16]  Jean Addington,et al.  Mapping structural covariance networks of facial emotion recognition in early psychosis: A pilot study , 2017, Schizophrenia Research.

[17]  G. Cottrell,et al.  EMPATH: A Neural Network that Categorizes Facial Expressions , 2002, Journal of Cognitive Neuroscience.

[18]  Saeed Setayeshi,et al.  Speech emotion recognition based on a modified brain emotional learning model , 2017, BICA 2017.

[19]  Ehsan Lotfi,et al.  Practical emotional neural networks , 2014, Neural Networks.

[20]  A. Young,et al.  Recognition of facial emotion in nine individuals with bilateral amygdala damage , 1999, Neuropsychologia.

[21]  Michael Koenigs,et al.  Emotion recognition deficits associated with ventromedial prefrontal cortex lesions are improved by gaze manipulation , 2016, Cortex.

[22]  S. Surguladze,et al.  Emotion Recognition in Blended Facial Expressions in Women with Anorexia Nervosa. , 2016, European eating disorders review : the journal of the Eating Disorders Association.

[23]  P. Fox,et al.  Pleiotropic locus for emotion recognition and amygdala volume identified using univariate and bivariate linkage. , 2015, The American journal of psychiatry.

[24]  S. Pollak,et al.  Developmental changes in the primacy of facial cues for emotion recognition. , 2016, Developmental psychology.

[25]  Ehsan Lotfi,et al.  Gene expression microarray classification using PCA-BEL , 2014, Comput. Biol. Medicine.

[26]  Qinke Peng,et al.  Detecting Susceptibility to Breast Cancer with SNP-SNP Interaction Using BPSOHS and Emotional Neural Networks , 2016, BioMed research international.

[27]  Mann Oo. Hay.  Emotion recognition in human-computer interaction , 2012 .

[28]  S. Herpertz,et al.  Oxytocin Promotes Facial Emotion Recognition and Amygdala Reactivity in Adults with Asperger Syndrome , 2014, Neuropsychopharmacology.

[29]  Vahid Nourani,et al.  An Emotional ANN (EANN) approach to modeling rainfall-runoff process , 2017 .