A review of depression and suicide risk assessment using speech analysis

Review of current diagnostic and assessment methods for depression and suicidality.Review the characteristics of active depressed and suicidal speech databases.Discuss the effects of depression and suicidality on common speech characteristics.Review of studies that use speech to classify or predict depression or suicidality.Discuss future challenges in finding a speech-based markers of either condition. This paper is the first review into the automatic analysis of speech for use as an objective predictor of depression and suicidality. Both conditions are major public health concerns; depression has long been recognised as a prominent cause of disability and burden worldwide, whilst suicide is a misunderstood and complex course of death that strongly impacts the quality of life and mental health of the families and communities left behind. Despite this prevalence the diagnosis of depression and assessment of suicide risk, due to their complex clinical characterisations, are difficult tasks, nominally achieved by the categorical assessment of a set of specific symptoms. However many of the key symptoms of either condition, such as altered mood and motivation, are not physical in nature; therefore assigning a categorical score to them introduces a range of subjective biases to the diagnostic procedure. Due to these difficulties, research into finding a set of biological, physiological and behavioural markers to aid clinical assessment is gaining in popularity. This review starts by building the case for speech to be considered a key objective marker for both conditions; reviewing current diagnostic and assessment methods for depression and suicidality including key non-speech biological, physiological and behavioural markers and highlighting the expected cognitive and physiological changes associated with both conditions which affect speech production. We then review the key characteristics; size, associated clinical scores and collection paradigm, of active depressed and suicidal speech databases. The main focus of this paper is on how common paralinguistic speech characteristics are affected by depression and suicidality and the application of this information in classification and prediction systems. The paper concludes with an in-depth discussion on the key challenges - improving the generalisability through greater research collaboration and increased standardisation of data collection, and the mitigating unwanted sources of variability - that will shape the future research directions of this rapidly growing field of speech processing research.

[1]  L. A. Abel,et al.  Quantitative assessment of smooth pursuit gain and catch-up saccades in schizophrenia and affective disorders , 1991, Biological Psychiatry.

[2]  Björn W. Schuller,et al.  Applying multiple classifiers and non-linear dynamics features for detecting sleepiness from speech , 2012, Neurocomputing.

[3]  J. Laver,et al.  Acoustic waveform perturbations and voice disorders , 1992 .

[4]  Huaiyu Yang,et al.  Rating Scales for Depression , 2009 .

[5]  J. Mundt,et al.  Vocal Acoustic Biomarkers of Depression Severity and Treatment Response , 2012, Biological Psychiatry.

[6]  C. Benkelfat,et al.  Patterns of gene expression in the limbic system of suicides with and without major depression , 2007, Molecular Psychiatry.

[7]  H Hollien,et al.  VOCAL INDICATORS OF PSYCHOLOGICAL STRESS , 1980, Annals of the New York Academy of Sciences.

[8]  J. Peifer,et al.  Analysis of prosodic variation in speech for clinical depression , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[9]  Darin D Dougherty,et al.  Using neuroimaging to predict treatment response in mood and anxiety disorders. , 2006, Annals of clinical psychiatry : official journal of the American Academy of Clinical Psychiatrists.

[10]  M. Landau Acoustical Properties of Speech as Indicators of Depression and Suicidal Risk , 2008 .

[11]  N. Schork,et al.  Discovery and validation of blood biomarkers for suicidality , 2013, Molecular Psychiatry.

[12]  H. Sackeim,et al.  Psychomotor symptoms of depression. , 1997, The American journal of psychiatry.

[13]  David A. Nielsen,et al.  The Genetics of Suicidal Behaviour , 2008 .

[14]  J. Mundt,et al.  Voice acoustic measures of depression severity and treatment response collected via interactive voice response (IVR) technology , 2007, Journal of Neurolinguistics.

[15]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[16]  Å. Nilsonne Speech characteristics as indicators of depressive illness , 1988, Acta psychiatrica Scandinavica.

[17]  Björn W. Schuller,et al.  Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge , 2011, Speech Commun..

[18]  Maja Pantic,et al.  Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge , 2013, AVEC@ACM Multimedia.

[19]  Thomas F. Quatieri,et al.  Phonologically-based biomarkers for major depressive disorder , 2011, EURASIP J. Adv. Signal Process..

[20]  J. Teasdale,et al.  Speech rate as a measure of short-term variation in depression. , 1980, The British journal of social and clinical psychology.

[21]  Monica Hoyos Flight Neuronal circuits: The sound of fear , 2012, Nature Reviews Neuroscience.

[22]  Paavo Alku,et al.  Glottal wave analysis with Pitch Synchronous Iterative Adaptive Inverse Filtering , 1991, Speech Commun..

[23]  Danielle van Westen,et al.  Size of basal ganglia in suicide attempters, and its association with temperament and serotonin transporter density , 2010, Psychiatry Research: Neuroimaging.

[24]  R. Bagby,et al.  The Hamilton Depression Rating Scale: has the gold standard become a lead weight? , 2004, The American journal of psychiatry.

[25]  J. Darby,et al.  Speech and voice parameters of depression: a pilot study. , 1984, Journal of communication disorders.

[26]  D J Kupfer,et al.  Exactly what does the Hamilton Depression Rating Scale measure? , 1993, Journal of psychiatric research.

[27]  J. Olesen,et al.  The economic cost of brain disorders in Europe , 2012, European journal of neurology.

[28]  J. G. Cull,et al.  Suicide Probability Scale , 2011 .

[29]  Jeonghun Ku,et al.  Nonverbal Social Behaviors of Patients With Bipolar Mania During Interactions With Virtual Humans , 2009, The Journal of nervous and mental disease.

[30]  Sarah W. Bisconer,et al.  Assessment of suicide risk in a psychiatric hospital. , 2007 .

[31]  Victor Zue,et al.  Speech database development at MIT: Timit and beyond , 1990, Speech Commun..

[32]  D. Mitchell Wilkes,et al.  Analysis of Vocal Tract Characteristics for Near-term Suicidal Risk Assessment , 2004, Methods of Information in Medicine.

[33]  Hande Kaymaz-Keskinpala,et al.  Screening for high risk suicidal states using mel-cepstral coefficients and energy in frequency bands , 2007, 2007 15th European Signal Processing Conference.

[34]  W. Drevets,et al.  Discovering Endophenotypes for Major Depression , 2004, Neuropsychopharmacology.

[35]  Thierry Dutoit,et al.  A comparative study of glottal source estimation techniques , 2019, Comput. Speech Lang..

[36]  Emil Kraepelin,et al.  Manic-depressive insanity and paranoia , 1976 .

[37]  Aude Billard,et al.  Robotic assistants in therapy and education of children with autism: can a small humanoid robot help encourage social interaction skills? , 2005, Universal Access in the Information Society.

[38]  Jeffrey F. Cohn,et al.  Detecting Depression Severity from Vocal Prosody , 2013, IEEE Transactions on Affective Computing.

[39]  D. Mitchell Wilkes,et al.  Objective estimation of suicidal risk using vocal output characteristics , 2006, INTERSPEECH.

[40]  Placzek Freundschaft und Sexualität. Fünfte vermehrte Auflage , 1921 .

[41]  Ville Lehtinen,et al.  Usefulness of the Beck Depression Inventory as a screening method for depression among the general population of Finland , 2009, Scandinavian journal of public health.

[42]  Albert A. Rizzo,et al.  Automatic behavior descriptors for psychological disorder analysis , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[43]  R A Steer,et al.  Suicide ideation at its worst point: a predictor of eventual suicide in psychiatric outpatients. , 1999, Suicide & life-threatening behavior.

[44]  J. Lépine,et al.  The increasing burden of depression , 2011, Neuropsychiatric disease and treatment.

[45]  A. Baddeley Working memory and language: an overview. , 2003, Journal of communication disorders.

[46]  D. Klatt,et al.  Analysis, synthesis, and perception of voice quality variations among female and male talkers. , 1990, The Journal of the Acoustical Society of America.

[47]  Nathan Schneider,et al.  Association for Computational Linguistics: Human Language Technologies , 2011 .

[48]  K. Scherer Vocal affect expression: a review and a model for future research. , 1986, Psychological bulletin.

[49]  Å. Nilsonne,et al.  Acoustic analysis of speech variables during depression and after improvement , 1987, Acta psychiatrica Scandinavica.

[50]  Matti Airas,et al.  TKK Aparat: An environment for voice inverse filtering and parameterization , 2008, Logopedics, phoniatrics, vocology.

[51]  Sylvia D. Kreibig,et al.  Autonomic nervous system activity in emotion: A review , 2010, Biological Psychology.

[52]  D Hell,et al.  The speech analysis approach to determining onset of improvement under antidepressants , 1998, European Neuropsychopharmacology.

[53]  J. John Mann,et al.  Prefrontal and Cerebellar Abnormalities in Major Depression: Evidence from Oculomotor Studies , 1998, Biological Psychiatry.

[54]  David Morganstein,et al.  Cost of lost productive work time among US workers with depression. , 2003, JAMA.

[55]  H P Godfrey,et al.  The Validity of Actometer and Speech Activity Measures in the Assessment of Depressed Patients , 1984, British Journal of Psychiatry.

[56]  H Hollien,et al.  [Vocal and speech patterns of depressive patients]. , 1977, Folia phoniatrica.

[57]  Nicholas B. Allen,et al.  Mel frequency cepstral feature and Gaussian Mixtures for modeling clinical depression in adolescents , 2009, 2009 8th IEEE International Conference on Cognitive Informatics.

[58]  Thomas F. Quatieri,et al.  Vocal biomarkers of depression based on motor incoordination , 2013, AVEC@ACM Multimedia.

[59]  Björn W. Schuller,et al.  Brute-forcing hierarchical functionals for paralinguistics: A waste of feature space? , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[60]  Louis-Philippe Morency,et al.  Automatic nonverbal behavior indicators of depression and PTSD: the effect of gender , 2014, Journal on Multimodal User Interfaces.

[61]  G. Northoff,et al.  Discovering imaging endophenotypes for major depression , 2011, Molecular Psychiatry.

[62]  Patrick Kenny,et al.  Front-End Factor Analysis for Speaker Verification , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[63]  Paul E. Croarkin,et al.  Evidence for GABAergic inhibitory deficits in major depressive disorder , 2011, Neuroscience & Biobehavioral Reviews.

[64]  R A Bryant,et al.  Interactions between BDNF Val66Met polymorphism and early life stress predict brain and arousal pathways to syndromal depression and anxiety , 2009, Molecular Psychiatry.

[65]  Jessica S. Brown,et al.  The psychology and neurobiology of suicidal behavior. , 2005, Annual review of psychology.

[66]  Roland Göcke,et al.  An Investigation of Depressed Speech Detection: Features and Normalization , 2011, INTERSPEECH.

[67]  Leopold Stein,et al.  Speech and Voice , 2018, Mental Health.

[68]  Shrikanth S. Narayanan,et al.  Automatic speaker age and gender recognition using acoustic and prosodic level information fusion , 2013, Comput. Speech Lang..

[69]  Michael Cannizzaro,et al.  Voice acoustical measurement of the severity of major depression , 2004, Brain and Cognition.

[70]  W. Coryell,et al.  Clinical predictors of suicide in primary major depressive disorder. , 2005, The Journal of clinical psychiatry.

[71]  Yogesh K. Dwivedi,et al.  Altered gene expression of brain-derived neurotrophic factor and receptor tyrosine kinase B in postmortem brain of suicide subjects. , 2003, Archives of general psychiatry.

[72]  Daniel A. Schneider,et al.  Empathic behavioral and physiological responses to dynamic stimuli in depression , 2012, Psychiatry Research.

[73]  Alexander Strobel,et al.  Serotonergic modulation in executive functioning: Linking genetic variations to working memory performance , 2011, Neuropsychologia.

[74]  Ronald S Duman,et al.  Functional Biomarkers of Depression: Diagnosis, Treatment, and Pathophysiology , 2011, Neuropsychopharmacology.

[75]  Paul E. Croarkin,et al.  Psychomotor retardation in depression: Biological underpinnings, measurement, and treatment , 2011, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[76]  Jutta Joormann,et al.  Updating the contents of working memory in depression: interference from irrelevant negative material. , 2008, Journal of abnormal psychology.

[77]  Sang-Won Nam,et al.  Pilot Study for Assessing the Behaviors of Patients with Schizophrenia towards a Virtual Avatar , 2006, Cyberpsychology Behav. Soc. Netw..

[78]  John H. L. Hansen,et al.  Nonlinear feature based classification of speech under stress , 2001, IEEE Trans. Speech Audio Process..

[79]  Thomas Quatieri,et al.  Discrete-Time Speech Signal Processing: Principles and Practice , 2001 .

[80]  Glyn Lewis,et al.  Adverse effects from antidepressant treatment: randomised controlled trial of 601 depressed individuals , 2014, Psychopharmacology.

[81]  M. Barrot,et al.  Neurobiology of Depression , 2002, Neuron.

[82]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[83]  J Sundberg,et al.  Perturbation and hoarseness: a pilot study of six children's voices. , 1996, Journal of voice : official journal of the Voice Foundation.

[84]  Y. Sheline Neuroimaging studies of mood disorder effects on the brain , 2003, Biological Psychiatry.

[85]  J. Lonnqvist,et al.  Suicide prevention strategies: a systematic review. , 2005, JAMA.

[86]  John T Maltsberger,et al.  The Role of Intense Affective States in Signaling a Suicide Crisis , 2007, The Journal of nervous and mental disease.

[87]  A. Postma Detection of errors during speech production: a review of speech monitoring models , 2000, Cognition.

[88]  Mats Lindström,et al.  Regional brain serotonin and dopamine transporter binding capacity in suicide attempters relate to impulsiveness and mental energy , 2006, Psychiatry Research: Neuroimaging.

[89]  Fernando De la Torre,et al.  Detecting depression from facial actions and vocal prosody , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[90]  A. Beck,et al.  Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. , 1996, Journal of personality assessment.

[91]  R. Rosenthal,et al.  Detecting State and Trait Anxiety from Auditory and Visual Cues: A Meta-Analysis , 2004, Personality & social psychology bulletin.

[92]  Robert F. Orlikoff,et al.  Influence of mean sound pressure level on jitter and shimmer measures , 1991 .

[93]  J. Peifer,et al.  Comparing objective feature statistics of speech for classifying clinical depression , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[94]  Stephen E. Silverman,et al.  Methods for evaluating near-term suicidal risk using vocal parameters , 2010 .

[95]  Willem J. M. Levelt,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[96]  Chris Cantor,et al.  Suicide in the Western World , 2008 .

[97]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[98]  G. MacQueen,et al.  The hippocampus in major depression: evidence for the convergence of the bench and bedside in psychiatric research? , 2011, Molecular Psychiatry.

[99]  Vidhyasaharan Sethu,et al.  Probabilistic acoustic volume analysis for speech affected by depression , 2014, INTERSPEECH.

[100]  Nicholas B. Allen,et al.  Detection of Clinical Depression in Adolescents’ Speech During Family Interactions , 2011, IEEE Transactions on Biomedical Engineering.

[101]  D. Watson Rethinking the mood and anxiety disorders: a quantitative hierarchical model for DSM-V. , 2005, Journal of abnormal psychology.

[102]  Gary Christopher,et al.  The impact of clinical depression on working memory , 2005, Cognitive neuropsychiatry.

[103]  M. Åsberg,et al.  A New Depression Scale Designed to be Sensitive to Change , 1979, British Journal of Psychiatry.

[104]  Elmar Nöth,et al.  Automatic modelling of depressed speech: relevant features and relevance of gender , 2014, INTERSPEECH.

[105]  R A Steer,et al.  Risk factors for suicide in psychiatric outpatients: a 20-year prospective study. , 2000, Journal of consulting and clinical psychology.

[106]  D. Mitchell Wilkes,et al.  Investigation of vocal jitter and glottal flow spectrum as possible cues for depression and near-term suicidal risk , 2004, IEEE Transactions on Biomedical Engineering.

[107]  Douglas A. Reynolds,et al.  Robust text-independent speaker identification using Gaussian mixture speaker models , 1995, IEEE Trans. Speech Audio Process..

[108]  J. G. Taylor,et al.  Emotion recognition in human-computer interaction , 2005, Neural Networks.

[109]  John Kane,et al.  Identifying Regions of Non-Modal Phonation Using Features of the Wavelet Transform , 2011, INTERSPEECH.

[110]  J. Stroop Studies of interference in serial verbal reactions. , 1992 .

[111]  Louis-Philippe Morency,et al.  It's only a computer: the impact of human-agent interaction in clinical interviews , 2014, AAMAS.

[112]  Ailbhe Ní Chasaide,et al.  Using phonetic feature extraction to determine optimal speech regions for maximising the effectiveness of glottal source analysis , 2013, INTERSPEECH.

[113]  Michael Wagner,et al.  Detecting depression: A comparison between spontaneous and read speech , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[114]  Hendrik van den Bussche,et al.  Does GP training in depression care affect patient outcome? - A systematic review and meta-analysis , 2012, BMC Health Services Research.

[115]  Rui Xia,et al.  Using i-Vector Space Model for Emotion Recognition , 2012, INTERSPEECH.

[116]  Raymond D. Kent Research on speech motor control and its disorders: a review and prospective. , 2000, Journal of communication disorders.

[117]  Mohammad H. Mahoor,et al.  Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses , 2014, Image Vis. Comput..

[118]  Philip S. Holzman,et al.  Horizontal and vertical pursuit eye movements, the oculocephalic reflex, and the functional psychoses , 1980, Psychiatry Research.

[119]  Patrice Mangin,et al.  Neurobiology of suicide: do biomarkers exist? , 2013, International Journal of Legal Medicine.

[120]  Roland Göcke,et al.  Diagnosis of depression by behavioural signals: a multimodal approach , 2013, AVEC@ACM Multimedia.

[121]  C. Segrin Social skills deficits associated with depression. , 2000, Clinical psychology review.

[122]  K. Kendler,et al.  Deconstructing major depression: a validation study of the DSM-IV symptomatic criteria , 2010, Psychological Medicine.

[123]  Z Ryn,et al.  [Attempted suicide]. , 1967, Polski tygodnik lekarski.

[124]  D. Mitchell Wilkes,et al.  Predicting severity of mental state using vocal output characteristics , 2007, MAVEBA.

[125]  Björn W. Schuller,et al.  AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge , 2014, AVEC '14.

[126]  Kallirroi Georgila,et al.  SimSensei kiosk: a virtual human interviewer for healthcare decision support , 2014, AAMAS.

[127]  Michael Frankfurter Melancholia A Disorder Of Movement And Mood A Phenomenological And Neurobiological Review , 2016 .

[128]  Nicholas B. Allen,et al.  Multichannel Weighted Speech Classification System for Prediction of Major Depression in Adolescents , 2013, IEEE Transactions on Biomedical Engineering.

[129]  Thilo Deckersbach,et al.  Functional Imaging of Mood and Anxiety Disorders , 2006, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[130]  Björn W. Schuller,et al.  Paralinguistics in speech and language - State-of-the-art and the challenge , 2013, Comput. Speech Lang..

[131]  Hugo Jair Escalante,et al.  Fusing Affective Dimensions and Audio-Visual Features from Segmented Video for Depression Recognition: INAOE-BUAP's Participation at AVEC'14 Challenge , 2014, AVEC '14.

[132]  H H Stassen,et al.  Speech characteristics in depression. , 1991, Psychopathology.

[133]  Thomas F. Quatieri,et al.  Vocal and Facial Biomarkers of Depression based on Motor Incoordination and Timing , 2014, AVEC '14.

[134]  Patrick Kenny,et al.  A Study of Interspeaker Variability in Speaker Verification , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[135]  Roy H. Perlis,et al.  40 – Care of the Suicidal Patient , 2010 .

[136]  Sridha Sridharan,et al.  Feature warping for robust speaker verification , 2001, Odyssey.

[137]  A. Bouhuys,et al.  Non-verbal interaction involvement as an indicator of prognosis in remitted depressed subjects , 2002, Psychiatry Research.

[138]  J. Markowitz,et al.  The 16-Item quick inventory of depressive symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression , 2003, Biological Psychiatry.

[139]  Albert Ali Salah,et al.  Ensemble CCA for Continuous Emotion Prediction , 2014, AVEC '14.

[140]  Tanaya Guha,et al.  Multimodal Prediction of Affective Dimensions and Depression in Human-Computer Interactions , 2014, AVEC '14.

[141]  Zhou Yu,et al.  Multimodal Prediction of Psychological Disorders: Learning Verbal and Nonverbal Commonalities in Adjacency Pairs , 2013 .

[142]  Nicholas B. Allen,et al.  Influence of acoustic low-level descriptors in the detection of clinical depression in adolescents , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[143]  Klaus Linde,et al.  Physicians' attitudes, diagnostic process and barriers regarding depression diagnosis in primary care: a systematic review of qualitative studies. , 2012, Family practice.

[144]  Björn W. Schuller,et al.  CCA based feature selection with application to continuous depression recognition from acoustic speech features , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[145]  Roland Göcke,et al.  Modeling spectral variability for the classification of depressed speech , 2013, INTERSPEECH.

[146]  Haizhou Li,et al.  An overview of text-independent speaker recognition: From features to supervectors , 2010, Speech Commun..

[147]  K. Scherer,et al.  Vocal indicators of psychiatric treatment effects in depressives and schizophrenics. , 1982, Journal of communication disorders.

[148]  A. Calev,et al.  Retrieval from semantic memory using meaningful and meaningless constructs by depressed, stable bipolar and manic patients. , 1989, The British journal of clinical psychology.

[149]  Masaru Mimura,et al.  Coping strategies for antidepressant side effects: an Internet survey. , 2012, Journal of affective disorders.

[150]  P. Ekman,et al.  Facial signs of emotional experience. , 1980 .

[151]  P. Bech,et al.  The heterogeneity of the depressive syndrome: when numbers get serious , 2011, Acta psychiatrica Scandinavica.

[152]  Eva Björkner,et al.  Throaty voice quality: subglottal pressure, voice source, and formant characteristics. , 2006, Journal of voice : official journal of the Voice Foundation.

[153]  Thomas F. Quatieri,et al.  Classification of depression state based on articulatory precision , 2013, INTERSPEECH.

[154]  Douglas D. O'Shaughnessy Speech Communications: Human and Machine , 2012 .

[155]  Nicholas B. Allen,et al.  Early prediction of major depression in adolescents using glottal wave characteristics and Teager Energy parameters , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[156]  Enrique Baca-García,et al.  Issues for DSM-V: suicidal behavior as a separate diagnosis on a separate axis. , 2008, The American journal of psychiatry.

[157]  Douglas E. Sturim,et al.  SVM Based Speaker Verification using a GMM Supervector Kernel and NAP Variability Compensation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[158]  I. Hickie,et al.  Classifying Depression by Mental State Signs , 1990, British Journal of Psychiatry.

[159]  M. Thase,et al.  Psychiatric rating scales. , 2012, Handbook of clinical neurology.

[160]  Eliathamby Ambikairajah,et al.  Spectro-temporal analysis of speech affected by depression and psychomotor retardation , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[161]  Vidhyasaharan Sethu,et al.  Speaker variability in speech based emotion models - Analysis and normalisation , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[162]  A. Mitchell,et al.  Clinical diagnosis of depression in primary care: a meta-analysis , 2009, The Lancet.

[163]  D. Mitchell Wilkes,et al.  Acoustical properties of speech as indicators of depression and suicidal risk , 2000, IEEE Transactions on Biomedical Engineering.

[164]  T. Robbins,et al.  Emotional bias and inhibitory control processes in mania and depression , 1999, Psychological Medicine.

[165]  C. Mathers,et al.  Projections of Global Mortality and Burden of Disease from 2002 to 2030 , 2006, PLoS medicine.

[166]  Mitchell J Prinstein,et al.  Introduction to the special section on suicide and nonsuicidal self-injury: a review of unique challenges and important directions for self-injury science. , 2008, Journal of consulting and clinical psychology.

[167]  Hans-Jürgen Möller,et al.  Association of the brain-derived neurotrophic factor Val66Met polymorphism with reduced hippocampal volumes in major depression. , 2007, Archives of general psychiatry.

[168]  M. Hamilton A RATING SCALE FOR DEPRESSION , 1960, Journal of neurology, neurosurgery, and psychiatry.

[169]  Cumhur Erkut,et al.  Real-Time Recognition of Percussive Sounds by a Model-Based Method , 2011, EURASIP J. Adv. Signal Process..

[170]  Laura Manea,et al.  Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis , 2012, Canadian Medical Association Journal.

[171]  Eva Björkner,et al.  Interdependencies among Voice Source Parameters in Emotional Speech , 2011, IEEE Transactions on Affective Computing.

[172]  Haizhou Li,et al.  GMM-SVM Kernel With a Bhattacharyya-Based Distance for Speaker Recognition , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[173]  M. Swerts,et al.  Verbal and Nonverbal Correlates for Depression: A Review , 2012 .

[174]  Kelly C. Cukrowicz,et al.  The interpersonal theory of suicide. , 2010, Psychological review.

[175]  Ailbhe Ní Chasaide,et al.  The role of voice quality in communicating emotion, mood and attitude , 2003, Speech Commun..

[176]  David J Kupfer,et al.  Neuropsychologic impairments in bipolar and unipolar mood disorders on the CANTAB neurocognitive battery , 2000, Biological Psychiatry.

[177]  Kallirroi Georgila,et al.  Verbal indicators of psychological distress in interactive dialogue with a virtual human , 2013, SIGDIAL Conference.

[178]  Gustavo Turecki,et al.  An examination of DSM-IV depressive symptoms and risk for suicide completion in major depressive disorder: a psychological autopsy study. , 2007, Journal of affective disorders.

[179]  Jitender Sareen,et al.  A population-based longitudinal study of risk factors for suicide attempts in major depressive disorder. , 2010, Journal of psychiatric research.

[180]  Alexander Neumeister,et al.  Evidence for continuing neuropsychological impairments in depression. , 2004, Journal of affective disorders.

[181]  I Sakinofsky,et al.  Clinical rating scales in suicide risk assessment. , 2000, General hospital psychiatry.

[182]  Robert D. Goldney,et al.  Prediction of Suicide and Attempted Suicide , 2008 .

[183]  Jacqueline Walker,et al.  A Review of Glottal Waveform Analysis , 2005, WNSP.

[184]  D. Mitchell Wilkes,et al.  Direct acoustic feature using iterative EM algorithm and spectral energy for classifying suicidal speech , 2007, INTERSPEECH.

[185]  R. de Raedt,et al.  Deficient inhibition of emotional information in depression. , 2006, Journal of affective disorders.

[186]  Louis-Philippe Morency,et al.  Audiovisual behavior descriptors for depression assessment , 2013, ICMI '13.

[187]  Christopher W. Drapeau,et al.  U.S.A. suicide 2016: Official final data , 2017 .

[188]  K. Oberauer Removing irrelevant information from working memory: a cognitive aging study with the modified Sternberg task. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[189]  R. Davidson,et al.  Depression: perspectives from affective neuroscience. , 2002, Annual review of psychology.

[190]  Barbara J. Sahakian,et al.  Elevated morning cortisol is a stratified population-level biomarker for major depression in boys only with high depressive symptoms , 2014, Proceedings of the National Academy of Sciences.

[191]  Miklós Palkovits,et al.  GABAA Receptor Promoter Hypermethylation in Suicide Brain: Implications for the Involvement of Epigenetic Processes , 2008, Biological Psychiatry.

[192]  Keith Hawton,et al.  Risk factors for suicide in individuals with depression: a systematic review. , 2013, Journal of affective disorders.

[193]  L. Henderson,et al.  Saccadic abnormalities in psychotic patients. I. Neuroleptic-free psychotic patients , 1995, Psychological Medicine.

[194]  Trevor Sharp,et al.  5-HT and depression: is the glass half-full? , 2011, Current opinion in pharmacology.

[195]  Chao-Yang Lee,et al.  "The Sound of Fear": assessing vocal fundamental frequency as a physiological indicator of social anxiety disorder. , 2012, Journal of anxiety disorders.

[196]  D. Stein,et al.  What is a mental/psychiatric disorder? From DSM-IV to DSM-V , 2010, Psychological Medicine.

[197]  Marc De Hert,et al.  Metabolic and cardiovascular adverse effects associated with antipsychotic drugs , 2012, Nature Reviews Endocrinology.

[198]  Roddy Cowie,et al.  Emotional speech: Towards a new generation of databases , 2003, Speech Commun..

[199]  Louis-Philippe Morency,et al.  Investigating the speech characteristics of suicidal adolescents , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[200]  Vibeke Horstmann,et al.  The long-term course of depressive disorders in the Lundby Study , 2007, Psychological Medicine.

[201]  Petros Maragos,et al.  Energy separation in signal modulations with application to speech analysis , 1993, IEEE Trans. Signal Process..

[202]  Margaret Lech,et al.  Effect of Clinical Depression on Automatic Speaker Identification , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[203]  Matthew K Nock,et al.  Suicide and suicidal behavior. , 2008, Epidemiologic reviews.

[204]  Elliot Moore,et al.  Critical Analysis of the Impact of Glottal Features in the Classification of Clinical Depression in Speech , 2008, IEEE Transactions on Biomedical Engineering.

[205]  D DeBrota,et al.  The responsiveness of the Hamilton Depression Rating Scale. , 2000, Journal of psychiatric research.

[206]  T. Brown,et al.  Reliability of DSM-IV anxiety and mood disorders: implications for the classification of emotional disorders. , 2001, Journal of abnormal psychology.

[207]  A. Haas,et al.  Recognizing and Responding to a Suicide Crisis , 2001, Annals of the New York Academy of Sciences.

[208]  J. H. Kamphuis,et al.  On categorical diagnoses in DSM-V: cutting dimensions at useful points? , 2009, Psychological assessment.

[209]  F. Schmidt,et al.  Linking "big" personality traits to anxiety, depressive, and substance use disorders: a meta-analysis. , 2010, Psychological bulletin.

[210]  Angeliki Metallinou,et al.  Speaker states recognition using latent factor analysis based Eigenchannel factor vector modeling , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[211]  A. Steiger,et al.  Wake and sleep EEG provide biomarkers in depression. , 2010, Journal of psychiatric research.

[212]  Tiago H. Falk,et al.  Model Fusion for Multimodal Depression Classification and Level Detection , 2014, AVEC '14.

[213]  Albert Ali Salah,et al.  Eyes Whisper Depression: A CCA based Multimodal Approach , 2014, ACM Multimedia.

[214]  D. Mitchell Wilkes,et al.  Analysis of fundamental frequency for near term suicidal risk assessment , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[215]  C. Bradshaw,et al.  Elongation of Pause-Time in Speech: A Simple, Objective Measure of Motor Retardation in Depression , 1976, British Journal of Psychiatry.

[216]  Vidhyasaharan Sethu,et al.  Speech Based Emotion Recognition , 2015 .

[217]  Eliathamby Ambikairajah,et al.  Cognitive load classification using formant features , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[218]  Sidney K. D'Mello,et al.  Consistent but modest: a meta-analysis on unimodal and multimodal affect detection accuracies from 30 studies , 2012, ICMI '12.

[219]  Michael Wagner,et al.  From Joyous to Clinically Depressed: Mood Detection Using Spontaneous Speech , 2012, FLAIRS.

[220]  H. Ring,et al.  Neuropsychiatry of the basal ganglia , 2002, Journal of neurology, neurosurgery, and psychiatry.

[221]  Haizhou Li,et al.  Dimension reduction of the modulation spectrogram for speaker verification , 2008, Odyssey.

[222]  Tamás D. Gedeon,et al.  A comparative study of different classifiers for detecting depression from spontaneous speech , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[223]  Cheng Yang,et al.  Plasma protein biomarkers of ALI and ARDS , 2017 .

[224]  J. Schelde Major depression: behavioral parameters of depression and recovery. , 1998, The Journal of nervous and mental disease.

[225]  W. Gaebel,et al.  Facial expressivity in the course of schizophrenia and depression , 2004, European Archives of Psychiatry and Clinical Neuroscience.

[226]  Roland Göcke,et al.  An approach for automatically measuring facial activity in depressed subjects , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[227]  Wolfgang Minker,et al.  Emotion Recognition and Depression Diagnosis by Acoustic and Visual Features: A Multimodal Approach , 2014, AVEC '14.

[228]  Jussi Jokinen,et al.  CSF 5-HIAA and DST non-suppression -independent biomarkers in suicide attempters? , 2008, Journal of affective disorders.

[229]  M. Åsberg,et al.  Neurotransmitters and Suicidal Behavior , 1997, Annals of the New York Academy of Sciences.

[230]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[231]  R. Spitzer,et al.  The PHQ-9: validity of a brief depression severity measure. , 2001, Journal of general internal medicine.

[232]  Marsha M. Linehan,et al.  Reasons for staying alive when you are thinking of killing yourself , 1983 .

[233]  Judith A. Hall,et al.  Nonverbal behavior in clinician—patient interaction , 1995 .

[234]  Björn W. Schuller,et al.  AVEC 2013: the continuous audio/visual emotion and depression recognition challenge , 2013, AVEC@ACM Multimedia.

[235]  P Bech,et al.  The Hamilton Depression Scale , 1981, Acta psychiatrica Scandinavica.

[236]  Thomas E Joiner,et al.  Suicide attempts associated with externalizing psychopathology in an epidemiological sample. , 2004, The American journal of psychiatry.

[237]  Mann Oo. Hay Emotion recognition in human-computer interaction , 2012 .

[238]  B. Carroll,et al.  Decrease in speech pause times with treatment of endogenous depression. , 1980, Biological psychiatry.

[239]  Dimitra Vergyri,et al.  The SRI AVEC-2014 Evaluation System , 2014, AVEC '14.

[240]  Vidhyasaharan Sethu,et al.  Phonetic and speaker variations in automatic emotion classification , 2008, INTERSPEECH.

[241]  M. Linehan,et al.  Reasons for staying alive when you are thinking of killing yourself: the reasons for living inventory. , 1983, Journal of consulting and clinical psychology.

[242]  T. Lidz,et al.  On attempted suicide. , 1958, A.M.A. archives of neurology and psychiatry.

[243]  M. Alpert,et al.  Reflections of depression in acoustic measures of the patient's speech. , 2001, Journal of affective disorders.

[244]  Will Earhart,et al.  Speech and Voice , 1931 .

[245]  C. Hamani,et al.  Deep brain stimulation for treatment-resistant depression. , 2010, The American journal of psychiatry.

[246]  Margaret Lech,et al.  Video-based detection of the clinical depression in adolescents , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[247]  M. Leboyer,et al.  Prefrontal cortex dysfunction in patients with suicidal behavior , 2006, Psychological Medicine.

[248]  Michael Wagner,et al.  Multimodal assistive technologies for depression diagnosis and monitoring , 2013, Journal on Multimodal User Interfaces.

[249]  FragopanagosN.,et al.  2005 Special Issue , 2005 .

[250]  J P Watson,et al.  Effects of communication content on speech behavior of depressives. , 1992, Comprehensive psychiatry.

[251]  Michael Wagner,et al.  Eye movement analysis for depression detection , 2013, 2013 IEEE International Conference on Image Processing.

[252]  B. Carroll,et al.  Speech pause time: a marker of psychomotor retardation among endogenous depressives. , 1981, Biological psychiatry.

[253]  Douglas A. Reynolds,et al.  Speaker Verification Using Adapted Gaussian Mixture Models , 2000, Digit. Signal Process..

[254]  B Luscher,et al.  The GABAergic deficit hypothesis of major depressive disorder , 2011, Molecular Psychiatry.

[255]  Thomas E Joiner,et al.  Warning signs for suicide on the Internet: a descriptive study. , 2006, Suicide & life-threatening behavior.

[256]  Dan J Stein,et al.  BDNF Polymorphisms Are Linked to Poorer Working Memory Performance, Reduced Cerebellar and Hippocampal Volumes and Differences in Prefrontal Cortex in a Swedish Elderly Population , 2014, PloS one.

[257]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[258]  Johan Sundberg,et al.  Differences in Ability of Musicians and Nonmusicians to Judge Emotional State from the Fundamental Frequency of Voice Samples , 1985 .

[259]  Kenneth E Freedland,et al.  Depression, the Autonomic Nervous System, and Coronary Heart Disease , 2005, Psychosomatic medicine.

[260]  R Jouvent,et al.  Speech pause time and the retardation rating scale for depression (ERD). Towards a reciprocal validation. , 1984, Journal of affective disorders.

[261]  Edward T. Bullmore,et al.  Plasma Protein Biomarkers for Depression and Schizophrenia by Multi Analyte Profiling of Case-Control Collections , 2010, PloS one.

[262]  Thomas F. Quatieri,et al.  On the relative importance of vocal source, system, and prosody in human depression , 2013, 2013 IEEE International Conference on Body Sensor Networks.

[263]  A. Lozano,et al.  Deep Brain Stimulation for Treatment-Resistant Depression , 2005, Neuron.

[264]  Thomas F. Quatieri,et al.  Vocal-Source Biomarkers for Depression: A Link to Psychomotor Activity , 2012, INTERSPEECH.

[265]  P. Maruff,et al.  Acoustic analysis of the effects of sustained wakefulness on speech. , 2010, The Journal of the Acoustical Society of America.

[266]  Vidhyasaharan Sethu,et al.  Variability compensation in small data: Oversampled extraction of i-vectors for the classification of depressed speech , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[267]  H H Stassen,et al.  Speaking behavior and voice sound characteristics in depressive patients during recovery. , 1993, Journal of psychiatric research.

[268]  J. Hillenbrand,et al.  Cepstral Peak Prominence: A More Reliable Measure of Dysphonia , 2003, The Annals of otology, rhinology, and laryngology.

[269]  Stacy Marsella,et al.  How virtual reality training can win friends and influence people , 2013 .

[270]  Nik Wahidah Hashim,et al.  Analysis of Timing Pattern of Speech as Possible Indicator for Near-Term Suicidal Risk and Depression in Male Patients , .

[271]  Shimon Sapir,et al.  Articulatory changes in muscle tension dysphonia: evidence of vowel space expansion following manual circumlaryngeal therapy. , 2009, Journal of communication disorders.

[272]  R. Lahoz-Beltra,et al.  Validation of laughter for diagnosis and evaluation of depression. , 2014, Journal of affective disorders.

[273]  J Sundberg,et al.  Measuring the rate of change of voice fundamental frequency in fluent speech during mental depression. , 1988, The Journal of the Acoustical Society of America.

[274]  Nathalie Henrich Bernardoni,et al.  The spectrum of glottal flow models , 2006 .

[275]  C. Crane,et al.  Suicide prevention by limiting access to methods: a review of theory and practice. , 2010, Social science & medicine.

[276]  Valery A. Petrushin,et al.  EMOTION IN SPEECH: RECOGNITION AND APPLICATION TO CALL CENTERS , 1999 .

[277]  Ronald C Kessler,et al.  Trends in suicide ideation, plans, gestures, and attempts in the United States, 1990-1992 to 2001-2003. , 2005, JAMA.

[278]  John Kane,et al.  Phonetic feature extraction for context-sensitive glottal source processing , 2014, Speech Commun..

[279]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[280]  B. Lithgow,et al.  Alpha-band characteristics in EEG spectrum indicate reliability of frontal brain asymmetry measures in diagnosis of depression. , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[281]  H. M. Teager,et al.  Evidence for Nonlinear Sound Production Mechanisms in the Vocal Tract , 1990 .

[282]  Constantine Kotropoulos,et al.  Emotional speech recognition: Resources, features, and methods , 2006, Speech Commun..

[283]  Louis-Philippe Morency,et al.  Investigating voice quality as a speaker-independent indicator of depression and PTSD , 2013, INTERSPEECH.

[284]  R.G. Shiavi,et al.  Distinguishing depression and suicidal risk in men using GMM based frequency contents of affective vocal tract response , 2008, 2008 International Conference on Control, Automation and Systems.

[285]  E. Gordon,et al.  Improving the Prediction of Treatment Response in Depression: Integration of Clinical, Cognitive, Psychophysiological, Neuroimaging, and Genetic Measures , 2008, CNS Spectrums.

[286]  Matthew K Nock,et al.  The American Association of Suicidology Warning Signs for Suicide : Theory , Research , and Clinical Applications , 2006 .

[287]  Michael F. Bunting,et al.  Working memory span tasks: A methodological review and user’s guide , 2005, Psychonomic bulletin & review.

[288]  Janet B W Williams Diagnostic and Statistical Manual of Mental Disorders , 2013 .

[289]  A. Flint,et al.  Abnormal speech articulation, psychomotor retardation, and subcortical dysfunction in major depression. , 1993, Journal of psychiatric research.

[290]  A. Beck,et al.  Depression: Causes and Treatment , 1967 .

[291]  A. Beck,et al.  An inventory for measuring clinical anxiety: psychometric properties. , 1988, Journal of consulting and clinical psychology.

[292]  Klaus R. Scherer,et al.  Vocal indicators of mood change in depression , 1996 .

[293]  Douglas E. Sturim,et al.  Automatic Detection of Depression in Speech Using Gaussian Mixture Modeling with Factor Analysis , 2011, INTERSPEECH.

[294]  Z. Breznitz,et al.  Verbal indicators of depression. , 1992, The Journal of general psychology.