Implementation of Deep Neural Networks in Facial Emotion Perception in Patients Suffering from Depressive Disorder: Promising Tool in the Diagnostic Process and Treatment Evaluation

According to World Health Organization, depression is a common illness worldwide, with more than 300 million sufferers. This article describes relatively new research that is giving Deep Neural Networks (DNN) and Expert System-based hybrid solutions, skills of recognizing human affect and its intensity in standardized manner with more precision and objectivity than human eye. At present diagnostic process of depression relies mostly on diagnostic and statistical manual (DSM-5) and international statistical classification of mental disorders (ICD-10) alongside other standardized clinical measures conducted by clinicians. Implementation of DNN in recognition facial affect in depression appears a promising diagnostic tool, in conjunction with above mentions classifications and clinical measures, via improving early detection of depressive symptoms or facilitating evaluation of treatment efficacy in depressive disorder. The article particularly aims at automatic analysis of facial affect in depressed individuals, highlighting applications together with challenges to their implementation in medicine.

[1]  Iain D. Craig,et al.  Blackboard systems , 2004, Artificial Intelligence Review.

[2]  P. Ekman,et al.  Facial Affect Scoring Technique: A First Validity Study , 1971 .

[3]  C. Kohler,et al.  Facial emotion perception in depression and bipolar disorder: A quantitative review , 2011, Psychiatry Research.

[4]  R. Gur,et al.  Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disorders , 2011, Journal of Neuroscience Methods.

[5]  Abhinav Dadhich.  Practical Computer Vision: Extract insightful information from images using TensorFlow, Keras, and OpenCV , 2018 .

[6]  L. Wolkenstein,et al.  Facial emotion recognition, theory of mind and the role of facial mimicry in depression. , 2017, Journal of affective disorders.

[7]  I. Gotlib,et al.  Judging the intensity of facial expressions of emotion: depression-related biases in the processing of positive affect. , 2009, Journal of abnormal psychology.

[8]  D. Perrett,et al.  Bipolar patients show mood‐congruent biases in sensitivity to facial expressions of emotion when exhibiting depressed symptoms, but not when exhibiting manic symptoms , 2006, Cognitive neuropsychiatry.

[9]  P. Ekman,et al.  EMFACS-7: Emotional Facial Action Coding System , 1983 .

[10]  Wen-hua Liu,et al.  Facial perception bias in patients with major depression , 2012, Psychiatry Research.

[11]  J. Cohn,et al.  Impact of depression on response to comedy: a dynamic facial coding analysis. , 2007, Journal of abnormal psychology.

[12]  B. Derntl,et al.  Facial emotion recognition in patients with bipolar I and bipolar II disorder. , 2009, The British journal of clinical psychology.

[13]  François Chollet,et al.  Deep Learning with Python , 2017 .

[14]  Krzysztof Michalik,et al.  Computational Representation of Medical Concepts: A Semiotic and Fuzzy Logic Approach , 2012, Soft Computing in Humanities and Social Sciences.

[15]  Daniel Graupe.  DEEP LEARNING NEURAL NETWORKS: DESIGN AND CASE STUDIES , 2016 .

[16]  J. Os,et al.  The size and burden of mental disorders and other disorders of the brain in Europe 2010 , 2011, European Neuropsychopharmacology.

[17]  Iain D. Craig.  Formal specification of advanced AI architectures , 1991, Ellis Horwood series in artificial intelligence.

[18]  Volker Arolt,et al.  Spatial processing of facial emotion in patients with unipolar depression: a longitudinal study. , 2004, Journal of affective disorders.

[19]  Michael F. Green,et al.  Perception of emotion and neurocognitive functioning in schizophrenia: what's the link? , 1998, Psychiatry Research.

[20]  H. Kraemer,et al.  Facial emotion discrimination: II. Behavioral findings in depression , 1992, Psychiatry Research.

[21]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  A. Bouhuys,et al.  Depressed patients' perceptions of facial emotions in depressed and remitted states are associated with relapse: a longitudinal study. , 1999, The Journal of nervous and mental disease.

[23]  W. Hale.  Judgment of facial expressions and depression persistence , 1998, Psychiatry Research.

[24]  Larry R. Medsker,et al.  Hybrid Neural Network and Expert Systems , 1994, Springer US.

[25]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[26]  Krzysztof Michalik,et al.  Application of Knowledge-Engineering Methods in Medical Knowledge Management , 2013 .

[27]  P. Ekman.  Emotion in the human face , 1982 .

[28]  M. Tarvainen,et al.  Intensified emotion perception in depression: Differences in physiological arousal and subjective perceptions , 2017, Psychiatry Research.

[29]  J. Hietanen,et al.  Depression biases the recognition of emotionally neutral faces , 2004, Psychiatry Research.

[30]  D. Luckenbaugh,et al.  Perception of facial emotion in adults with bipolar or unipolar depression and controls. , 2010, Journal of psychiatric research.

[31]  L. Judd,et al.  Psychosocial disability in the course of bipolar I and II disorders: a prospective, comparative, longitudinal study. , 2005, Archives of general psychiatry.

[32]  Lisanne M. Jenkins,et al.  Integrated cross-network connectivity of amygdala, insula, and subgenual cingulate associated with facial emotion perception in healthy controls and remitted major depressive disorder , 2017, Cognitive, Affective, & Behavioral Neuroscience.