Automatic Nonverbal Behavior Indicators of Depression and PTSD: Exploring Gender Differences

In this paper, we show that gender plays an important role in the automatic assessment of psychological conditions such as depression and post-traumatic stress disorder (PTSD). We identify a directly interpretable and intuitive set of predictive indicators, selected from three general categories of nonverbal behaviors: affect, expression variability and motor variability. For the analysis, we introduce a semi-structured virtual human interview dataset which includes 53 video recorded interactions. Our experiments on automatic classification of psychological conditions show that a gender-dependent approach significantly improves the performance over a gender agnostic one.

[1]  Roland Göcke,et al.  An approach for automatically measuring facial activity in depressed subjects , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[2]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[3]  J. Cohn,et al.  Impact of depression on response to comedy: a dynamic facial coding analysis. , 2007, Journal of abnormal psychology.

[4]  Nicole C. Krämer,et al.  It's in Their Eyes: A Study on Female and Male Virtual Humans' Gaze , 2011, IVA.

[5]  E. Blanchard,et al.  Psychometric properties of the PTSD Checklist (PCL). , 1996, Behaviour research and therapy.

[6]  Matt J. Gray,et al.  A cross-lagged analysis of the relationship between symptoms of PTSD and retrospective reports of exposure. , 2006, Journal of anxiety disorders.

[7]  Albert A. Rizzo,et al.  Automatic behavior descriptors for psychological disorder analysis , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[8]  Gwen Littlewort,et al.  The computer expression recognition toolbox (CERT) , 2011, Face and Gesture 2011.

[9]  A. Graesser,et al.  Dynamics of affective states during complex learning , 2012 .

[10]  F. Deutsch,et al.  What is in a Smile? , 1987 .

[11]  R. Spitzer,et al.  The PHQ-9: A new depression diagnostic and severity measure , 2002 .

[12]  P. Ekman,et al.  Facial Expression in Affective Disorders , 2005 .

[13]  Peter Robinson,et al.  3D Constrained Local Model for rigid and non-rigid facial tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  D. G. Campbell,et al.  Prevalence of Depression–PTSD Comorbidity: Implications for Clinical Practice Guidelines and Primary Care-based Interventions , 2007, Journal of General Internal Medicine.

[15]  S. Brunnhuber,et al.  Facial Expression and Experience of Emotions in Psychodynamic Interviews with Patients with PTSD in Comparison to Healthy Subjects , 2007, Psychopathology.

[16]  T. W. Miller,et al.  Posttraumatic stress disorder after treatment for breast cancer: prevalence of diagnosis and use of the PTSD Checklist-Civilian Version (PCL-C) as a screening instrument. , 1998, Journal of consulting and clinical psychology.

[17]  L. Hedges.  Distribution Theory for Glass's Estimator of Effect size and Related Estimators , 1981 .

[18]  Fernando De la Torre,et al.  Detecting depression from facial actions and vocal prosody , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[19]  A. Troisi,et al.  Gender differences in depression: an ethological study of nonverbal behavior during interviews. , 1999, Journal of psychiatric research.

[20]  Stefan Kopp,et al.  Know Your Users! Empirical Results for Tailoring an Agent's Nonverbal Behavior to Different User Groups , 2010, IVA.

[21]  Reginald B. Adams,et al.  Who may frown and who should smile? Dominance, affiliation, and the display of happiness and anger , 2005 .

[22]  H. Ellgring.  Nonverbal communication in depression , 1989 .

[23]  Margaret Lech,et al.  Video-based detection of the clinical depression in adolescents , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999, Journal of personality and social psychology.

[25]  Christian Küblbeck,et al.  Face detection and tracking in video sequences using the modifiedcensus transformation , 2006, Image Vis. Comput..

[26]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[27]  Javier R. Movellan,et al.  Generalized adaptive view-based appearance model: Integrated framework for monocular head pose estimation , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[28]  Winfried Rief,et al.  Base rates for panic and depression according to the Brief Patient Health Questionnaire: a population-based study. , 2004, Journal of affective disorders.

[29]  G. Bonanno,et al.  Facial expressions of emotion and the course of conjugal bereavement. , 1997, Journal of abnormal psychology.