Head Pose and Movement Analysis as an Indicator of Depression

Depression is a common and disabling mental health disorder, which impacts not only on the sufferer but also their families, friends and the economy overall. Our ultimate aim is to develop an automatic objective affective sensing system that supports clinicians in their diagnosis and monitoring of clinical depression. Here, we analyse the performance of head pose and movement features extracted from face videos using a 3D face model projected on a 2D Active Appearance Model (AAM). In a binary classification task (depressed vs. non-depressed), we modelled low-level and statistical functional features for an SVM classifier using real-world clinically validated data. Although the head pose and movement would be used as a complementary cue in detecting depression in practice, their recognition rate was impressive on its own, giving 71.2% on average, which illustrates that head pose and movement hold effective cues in diagnosing depression. When expressing positive and negative emotions, recognising depression using positive emotions was more accurate than using negative emotions. We conclude that positive emotions are expressed less in depressed subjects at all times, and that negative emotions have less discriminatory power than positive emotions in detecting depression. Analysing the functional features statistically illustrates several behaviour patterns for depressed subjects: (1) slower head movements, (2) less change of head position, (3) longer duration of looking to the right, (4) longer duration of looking down, which may indicate fatigue and eye contact avoidance. We conclude that head movements are significantly different between depressed patients and healthy subjects, and could be used as a complementary cue.

[1]  F. E. Grubbs Procedures for Detecting Outlying Observations in Samples , 1969 .

[2]  S. Guze,et al.  Suicide and Primary Affective Disorders , 1970, British Journal of Psychiatry.

[3]  P. Waxer Nonverbal cues for depression. , 1974, Journal of abnormal psychology.

[4]  F. McNair Understanding depression. , 1981, Canadian family physician Medecin de famille canadien.

[5]  L. Fossi,et al.  The Ethological Approach to the Assessment of Depressive Disorders , 1984, The Journal of nervous and mental disease.

[6]  S. Nolen-Hoeksema,et al.  Sex Differences in Unipolar Depression: Evidence and Theory Background on the Affective Disorders , 1987 .

[7]  G. Andrews,et al.  The Long-Term Outcome of Depressive Illness , 1988, British Journal of Psychiatry.

[8]  J. Pedersen,et al.  An ethological description of depression , 1988, Acta psychiatrica Scandinavica.

[9]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .

[10]  W. Hale,et al.  Non-verbal behavioral interactions of depressed patients with partners and strangers: the role of behavioral social support and involvement in depression persistence. , 1997, Journal of affective disorders.

[11]  D. Mitchell Wilkes,et al.  Analysis of fundamental frequency for near term suicidal risk assessment , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[14]  N. Niedermaier,et al.  Prevention and treatment of poststroke depression with mirtazapine in patients with acute stroke. , 2004, The Journal of clinical psychiatry.

[15]  Larry S. Davis,et al.  Model-based object pose in 25 lines of code , 1992, International Journal of Computer Vision.

[16]  L. Matza,et al.  Misdiagnosed patients with bipolar disorder: comorbidities, treatment patterns, and direct treatment costs. , 2005, The Journal of clinical psychiatry.

[17]  Dirk Heylen,et al.  Head Gestures, Gaze and the Principles of Conversational Structure , 2006, Int. J. Humanoid Robotics.

[18]  Roland Göcke,et al.  Iterative Error Bound Minimisation for AAM Alignment , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  J. Mundt,et al.  Voice acoustic measures of depression severity and treatment response collected via interactive voice response (IVR) technology , 2007, Journal of Neurolinguistics.

[20]  Elliot Moore,et al.  Critical Analysis of the Impact of Glottal Features in the Classification of Clinical Depression in Speech , 2008, IEEE Transactions on Biomedical Engineering.

[21]  Jorge P. Batista,et al.  Monocular Head Pose Estimation , 2008, ICIAR.

[22]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Michael Wagner,et al.  From Joyous to Clinically Depressed: Mood Detection Using Spontaneous Speech , 2012, FLAIRS.

[24]  Tamás D. Gedeon,et al.  A comparative study of different classifiers for detecting depression from spontaneous speech , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.