Data collection of elicited facial expressions and speech responses for mood disorder detection

Mood disorders include unipolar disorder (UD) and bipolar disorder (BD). In this work, database collection of facial expressions and speech responses based on eliciting emotional videos for mood disorder detection is proposed. First, the chi-squared test was used to evaluate the agreement among manual selection of eliciting emotional videos from 11 candidate emotion videos. Six eliciting emotional videos were selected and then applied to elicit speech responses and facial expressions of the patients. In this paper, the collection procedure of the elicited data is described and the statistics of the database is provided. The collected mood database can be used in mood disorder detection and studies on emotions from elicitation.

[1]  M. Hamilton.  A RATING SCALE FOR DEPRESSION , 1960, Journal of neurology, neurosurgery, and psychiatry.

[2]  Chung-Hsien Wu,et al.  Survey on audiovisual emotion recognition: databases, features, and data fusion strategies , 2014, APSIPA Transactions on Signal and Information Processing.

[3]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[4]  Oscar Mayora-Ibarra,et al.  Smartphone-Based Recognition of States and State Changes in Bipolar Disorder Patients , 2015, IEEE Journal of Biomedical and Health Informatics.

[5]  J. Calabrese,et al.  Development and validation of a screening instrument for bipolar spectrum disorder: the Mood Disorder Questionnaire. , 2000, The American journal of psychiatry.

[6]  Chung-Hsien Wu,et al.  Emotion Recognition of Affective Speech Based on Multiple Classifiers Using Acoustic-Prosodic Information and Semantic Labels , 2015, IEEE Transactions on Affective Computing.

[7]  T. Barnes.  A Rating Scale for Drug-Induced Akathisia , 1989, British Journal of Psychiatry.

[8]  R. C. Young,et al.  A Rating Scale for Mania: Reliability, Validity and Sensitivity , 1978, British Journal of Psychiatry.

[9]  J. Rabe-Jabłońska,et al.  [Affective disorders in the fourth edition of the classification of mental disorders prepared by the American Psychiatric Association -- diagnostic and statistical manual of mental disorders]. , 1993, Psychiatria polska.

[10]  C. Andreou,et al.  Impaired perception of affective prosody in remitted patients with bipolar disorder. , 2007, The Journal of neuropsychiatry and clinical neurosciences.

[11]  Enzo Pasquale Scilingo,et al.  Electrodermal Activity in Bipolar Patients during Affective Elicitation , 2014, IEEE Journal of Biomedical and Health Informatics.

[12]  R. Moreno,et al.  Facial emotion recognition and its correlation with executive functions in bipolar I patients and healthy controls. , 2014, Journal of affective disorders.

[13]  Chung-Hsien Wu,et al.  Error Weighted Semi-Coupled Hidden Markov Model for Audio-Visual Emotion Recognition , 2012, IEEE Transactions on Multimedia.

[14]  Scott A Langenecker,et al.  Face Emotion Perception and Executive Functioning Deficits in Depression , 2005, Journal of clinical and experimental neuropsychology.

[15]  V. Osmani,et al.  Correlation of significant places with self-reported state of bipolar disorder patients , 2014 .

[16]  Newton Howard,et al.  Approach Towards a Natural Language Analysis for Diagnosing Mood Disorders and Comorbid Conditions , 2013, 2013 12th Mexican International Conference on Artificial Intelligence.

[17]  S. Leucht,et al.  Efficacy and extrapyramidal side-effects of the new antipsychotics olanzapine, quetiapine, risperidone, and sertindole compared to conventional antipsychotics and placebo. A meta-analysis of randomized controlled trials , 1999, Schizophrenia Research.

[18]  A. Young,et al.  Recognition accuracy and response bias to happy and sad facial expressions in patients with major depression. , 2004, Neuropsychology.

[19]  John Suckling,et al.  Explicit and Implicit Facial Affect Recognition in Manic and Depressed States of Bipolar Disorder: A Functional Magnetic Resonance Imaging Study , 2006, Biological Psychiatry.

[20]  Chung-Hsien Wu,et al.  Speaking Effect Removal on Emotion Recognition From Facial Expressions Based on Eigenface Conversion , 2013, IEEE Transactions on Multimedia.

[21]  Chung-Hsien Wu,et al.  Two-Level Hierarchical Alignment for Semi-Coupled HMM-Based Audiovisual Emotion Recognition With Temporal Course , 2013, IEEE Transactions on Multimedia.

[22]  M. Fava,et al.  Clinical Global Impression Scale—Severity of Fatigue , 2014 .

[23]  T. Dalgleish.  Basic Emotions , 2004 .

[24]  Dermot Diamond,et al.  Development of portable device for monitoring the lithium level from bipolar disorder patients , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[25]  Fernando De la Torre,et al.  Detecting depression from facial actions and vocal prosody , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.