The Predictive Validity of Machine Learning Models in the Classification and Treatment of Major Depressive Disorder: State of the Art and Future Directions

Major depressive disorder imposes a substantial disease burden worldwide, ranking as the third leading contributor to global disability. In spite of its ubiquity, classifying and treating depression has proven troublesome. One argument put forward to explain this predicament is the heterogeneity of patients diagnosed with the disorder. Recently, many areas of daily life have witnessed the surge of machine learning techniques, computational approaches to elucidate complex patterns in large datasets, which can be employed to make predictions and detect relevant clusters. Due to the multidimensionality at play in the pathogenesis of depression, it is suggested that machine learning could contribute to improving classification and treatment. In this paper, we investigated literature focusing on the use of machine learning models on datasets with clinical variables of patients diagnosed with depression to predict treatment outcomes or find more homogeneous subgroups. Identified studies based on best practices in the field are evaluated. We found 16 studies predicting outcomes (such as remission) and identifying clusters in patients with depression. The identified studies are mostly still in proof-of-concept phase, with small datasets, lack of external validation, and providing single performance metrics. Larger datasets, and models with similar variables present across these datasets, are needed to develop accurate and generalizable models. We hypothesize that harnessing natural language processing to obtain data ‘hidden' in clinical texts might prove useful in improving prediction models. Besides, researchers will need to focus on the conditions to feasibly implement these models to support psychiatrists and patients in their decision-making in practice. Only then we can enter the realm of precision psychiatry.

[1]  Alfredo Vellido,et al.  The importance of interpretability and visualization in machine learning for applications in medicine and health care , 2019, Neural Computing and Applications.

[2]  Fei Wang,et al.  AI in Health: State of the Art, Challenges, and Future Directions , 2019, Yearbook of Medical Informatics.

[3]  James Cussens,et al.  Predicting persistent depressive symptoms in older adults: A machine learning approach to personalised mental healthcare. , 2019, Journal of affective disorders.

[4]  David Benrimoh,et al.  A systematic meta-review of predictors of antidepressant treatment outcome in major depressive disorder. , 2019, Journal of affective disorders.

[5]  Haniye Sadat Sajadi,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017 , 2018, The Lancet.

[6]  D. Maurer,et al.  Depression: Screening and Diagnosis. , 2018, American Family Physician.

[7]  Oleg S. Pianykh,et al.  Current Applications and Future Impact of Machine Learning in Radiology. , 2018, Radiology.

[8]  Jieping Ye,et al.  Predictive modeling of treatment resistant depression using data from STAR*D and an independent clinical study , 2018, PloS one.

[9]  P. Falkai,et al.  Machine Learning Approaches for Clinical Psychology and Psychiatry. , 2018, Annual review of clinical psychology.

[10]  R. DeRubeis,et al.  Treatment Selection in Depression. , 2018, Annual review of clinical psychology.

[11]  W. Tam,et al.  Prevalence of Depression in the Community from 30 Countries between 1994 and 2014 , 2018, Scientific Reports.

[12]  Rupert Lanzenberger,et al.  Refining Prediction in Treatment-Resistant Depression: Results of Machine Learning Analyses in the TRD III Sample. , 2017, The Journal of clinical psychiatry.

[13]  A. Meyer-Lindenberg,et al.  Machine Learning for Precision Psychiatry: Opportunities and Challenges. , 2017, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[14]  N. Koutsouleris,et al.  The perilous path from publication to practice , 2018, Molecular Psychiatry.

[15]  Claire M. Gillan,et al.  What big data can do for treatment in psychiatry , 2017, Current Opinion in Behavioral Sciences.

[16]  Ziad Obermeyer,et al.  Lost in Thought - The Limits of the Human Mind and the Future of Medicine. , 2017, The New England journal of medicine.

[17]  F. Cabitza,et al.  Unintended Consequences of Machine Learning in Medicine , 2017, JAMA.

[18]  Wei Zeng,et al.  A numerical framework for interstitial fluid pressure imaging in poroelastic MRE , 2017, PloS one.

[19]  J. Kai,et al.  Can machine-learning improve cardiovascular risk prediction using routine clinical data? , 2017, PloS one.

[20]  Harlan M. Krumholz,et al.  Reevaluating the Efficacy and Predictability of Antidepressant Treatments: A Symptom Clustering Approach , 2017, JAMA psychiatry.

[21]  E. Fried,et al.  Moving forward: how depression heterogeneity hinders progress in treatment and research , 2017, Expert review of neurotherapeutics.

[22]  Rupert Lanzenberger,et al.  A New Prediction Model for Evaluating Treatment-Resistant Depression. , 2017, The Journal of clinical psychiatry.

[23]  Ann John,et al.  Data science for mental health: a UK perspective on a global challenge. , 2016, The lancet. Psychiatry.

[24]  M. Ghassemi,et al.  Predicting early psychiatric readmission with natural language processing of narrative discharge summaries , 2016, Translational psychiatry.

[25]  R. Iniesta,et al.  Machine learning, statistical learning and the future of biological research in psychiatry , 2016, Psychological Medicine.

[26]  M. Rietschel,et al.  Combining clinical variables to optimize prediction of antidepressant treatment outcomes. , 2016, Journal of psychiatric research.

[27]  Marcia K. Johnson,et al.  Cross-trial prediction of treatment outcome in depression: a machine learning approach. , 2016, The lancet. Psychiatry.

[28]  Donia Scott,et al.  Extracting information from the text of electronic medical records to improve case detection: a systematic review , 2016, J. Am. Medical Informatics Assoc..

[29]  Tianxi Cai,et al.  Testing a machine-learning algorithm to predict the persistence and severity of major depressive disorder from baseline self-reports , 2015, Molecular Psychiatry.

[30]  Arnoud Arntz,et al.  Predicting Optimal Outcomes in Cognitive Therapy or Interpersonal Psychotherapy for Depressed Individuals Using the Personalized Advantage Index Approach , 2015, PloS one.

[31]  Allison C. Nugent,et al.  Ketamine and other N-methyl-D-aspartate receptor antagonists in the treatment of depression: a perspective review , 2015, Therapeutic advances in chronic disease.

[32]  Marie E. Herberstein,et al.  Prevalence and Molecular Identification of Nematode and Dipteran Parasites in an Australian Alpine Grasshopper (Kosciuscola tristis) , 2015, PloS one.

[33]  Steve Halligan,et al.  Disadvantages of using the area under the receiver operating characteristic curve to assess imaging tests: A discussion and proposal for an alternative approach , 2015, European Radiology.

[34]  Tianxi Cai,et al.  MAJOR DEPRESSIVE DISORDER SUBTYPES TO PREDICT LONG‐TERM COURSE , 2014, Depression and anxiety.

[35]  R. A. Schoevers,et al.  The effects of comorbidity in defining major depression subtypes associated with long-term course and severity , 2018 .

[36]  Nigam H. Shah,et al.  Toward personalizing treatment for depression: predicting diagnosis and severity , 2014, J. Am. Medical Informatics Assoc..

[37]  David C. Reutens,et al.  Elemental Spatial and Temporal Association Formation in Left Temporal Lobe Epilepsy , 2014, PloS one.

[38]  K. Foote,et al.  Deep Brain Stimulation for Treatment-resistant Depression: Systematic Review of Clinical Outcomes , 2014, Neurotherapeutics.

[39]  Zachary D. Cohen,et al.  The Personalized Advantage Index: Translating Research on Prediction into Individualized Treatment Recommendations. A Demonstration , 2014, PloS one.

[40]  F. Jain,et al.  PREDICTIVE SOCIOECONOMIC AND CLINICAL PROFILES OF ANTIDEPRESSANT RESPONSE AND REMISSION , 2013, Depression and anxiety.

[41]  R. Perlis A Clinical Risk Stratification Tool for Predicting Treatment Resistance in Major Depressive Disorder , 2013, Biological Psychiatry.

[42]  Michael B. First,et al.  Consensus Report of the APA Work Group on Neuroimaging Markers of Psychiatric Disorders RESOURCE DOCUMENT , 2012 .

[43]  P. Bech,et al.  The heterogeneity of the depressive syndrome: when numbers get serious , 2011, Acta psychiatrica Scandinavica.

[44]  M. Fava,et al.  Using electronic medical records to enable large-scale studies in psychiatry: treatment resistant depression as a model , 2011, Psychological Medicine.

[45]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[46]  Gregory E Simon,et al.  Personalized medicine for depression: can we match patients with treatments? , 2010, The American journal of psychiatry.

[47]  A. Kuk,et al.  Recursive subsetting to identify patients in the STAR*D: a method to enhance the accuracy of early prediction of treatment outcome and to inform personalized care. , 2010, The Journal of clinical psychiatry.

[48]  R. DeRubeis,et al.  Antidepressant drug effects and depression severity: a patient-level meta-analysis. , 2010, JAMA.

[49]  Bradley N Gaynes,et al.  What did STAR*D teach us? Results from a large-scale, practical, clinical trial for patients with depression. , 2009, Psychiatric services.

[50]  A. Mitchell,et al.  Clinical diagnosis of depression in primary care: a meta-analysis , 2009, The Lancet.

[51]  Michael N. Liebman,et al.  Clinical prediction of antidepressant response in mood disorders: Linear multivariate vs. neural network models , 2007, Psychiatry Research.

[52]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.