Predictive modeling of treatment resistant depression using data from STAR*D and an independent clinical study

Identification of risk factors of treatment resistance may be useful to guide treatment selection, avoid inefficient trial-and-error, and improve major depressive disorder (MDD) care. We extended the work in predictive modeling of treatment resistant depression (TRD) via partition of the data from the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) cohort into a training and a testing dataset. We also included data from a small yet completely independent cohort RIS-INT-93 as an external test dataset. We used features from enrollment and level 1 treatment (up to week 2 response only) of STAR*D to explore the feature space comprehensively and applied machine learning methods to model TRD outcome at level 2. For TRD defined using QIDS-C16 remission criteria, multiple machine learning models were internally cross-validated in the STAR*D training dataset and externally validated in both the STAR*D testing dataset and RIS-INT-93 independent dataset with an area under the receiver operating characteristic curve (AUC) of 0.70–0.78 and 0.72–0.77, respectively. The upper bound for the AUC achievable with the full set of features could be as high as 0.78 in the STAR*D testing dataset. Model developed using top 30 features identified using feature selection technique (k-means clustering followed by χ2 test) achieved an AUC of 0.77 in the STAR*D testing dataset. In addition, the model developed using overlapping features between STAR*D and RIS-INT-93, achieved an AUC of > 0.70 in both the STAR*D testing and RIS-INT-93 datasets. Among all the features explored in STAR*D and RIS-INT-93 datasets, the most important feature was early or initial treatment response or symptom severity at week 2. These results indicate that prediction of TRD prior to undergoing a second round of antidepressant treatment could be feasible even in the absence of biomarker data.

[1]  M. Weissman,et al.  Moderation of the Relationship Between Reward Expectancy and Prediction Error-Related Ventral Striatal Reactivity by Anhedonia in Unmedicated Major Depressive Disorder: Findings From the EMBARC Study. , 2015, The American journal of psychiatry.

[2]  D J Kupfer,et al.  Exactly what does the Hamilton Depression Rating Scale measure? , 1993, Journal of psychiatric research.

[3]  Julien Mendlewicz,et al.  Clinical factors associated with treatment resistance in major depressive disorder: results from a European multicenter study. , 2007, The Journal of clinical psychiatry.

[4]  Aart H Schene,et al.  Staging methods for treatment resistant depression. A systematic review. , 2012, Journal of affective disorders.

[5]  M. Hamilton A RATING SCALE FOR DEPRESSION , 1960, Journal of neurology, neurosurgery, and psychiatry.

[6]  Meindert Danhof,et al.  Sensitivity of the individual items of the Hamilton depression rating scale to response and its consequences for the assessment of efficacy. , 2008, Journal of psychiatric research.

[7]  D. Kupfer,et al.  Sequenced treatment alternatives to relieve depression (STAR*D): rationale and design. , 2004, Controlled clinical trials.

[8]  P. Bech,et al.  QUANTITATIVE RATING OF DEPRESSIVE STATES , 1975, Acta psychiatrica Scandinavica.

[9]  Kenji Hashimoto,et al.  Low Openness on the Revised NEO Personality Inventory as a Risk Factor for Treatment-Resistant Depression , 2013, PloS one.

[10]  Huan Liu,et al.  Chi2: feature selection and discretization of numeric attributes , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[11]  R. Perlis A Clinical Risk Stratification Tool for Predicting Treatment Resistance in Major Depressive Disorder , 2013, Biological Psychiatry.

[12]  A. Kuk,et al.  Recursive subsetting to identify patients in the STAR*D: a method to enhance the accuracy of early prediction of treatment outcome and to inform personalized care. , 2010, The Journal of clinical psychiatry.

[13]  M. Weissman,et al.  Accounting for Dynamic Fluctuations across Time when Examining fMRI Test-Retest Reliability: Analysis of a Reward Paradigm in the EMBARC Study , 2015, PloS one.

[14]  Marcin Siwek,et al.  Risk factors of treatment resistance in major depression: association with bipolarity. , 2010, Journal of affective disorders.

[15]  Verinder Sharma,et al.  A closer look at treatment resistant depression: is it due to a bipolar diathesis? , 2005, Journal of affective disorders.

[16]  Aart H Schene,et al.  The Dutch Measure for quantification of Treatment Resistance in Depression (DM-TRD): an extension of the Maudsley Staging Method. , 2016, Journal of affective disorders.

[17]  M. Leboyer,et al.  Risk factors for treatment resistance in unipolar depression: a systematic review. , 2015, Journal of affective disorders.

[18]  P Bech,et al.  The Hamilton Depression Scale , 1981, Acta psychiatrica Scandinavica.

[19]  W. Maier,et al.  Comparative analysis of observer depression scales , 1985, Acta psychiatrica Scandinavica.

[20]  S. S. Young,et al.  Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment , 1993 .

[21]  Qingyang Li,et al.  Melancholic Depression Prediction by Identifying Representative Features in Metabolic and Microarray Profiles with Missing Values , 2015, Pacific Symposium on Biocomputing.

[22]  M. Hamilton,et al.  Development of a rating scale for primary depressive illness. , 1967, The British journal of social and clinical psychology.

[23]  D. Kupfer,et al.  Background and rationale for the sequenced treatment alternatives to relieve depression (STAR*D) study. , 2003, The Psychiatric clinics of North America.

[24]  S. Geer,et al.  Correlated variables in regression: Clustering and sparse estimation , 2012, 1209.5908.

[25]  I. Heuser,et al.  Improving depression severity assessment--II. Content, concurrent and external validity of three observer depression scales. , 1988, Journal of psychiatric research.

[26]  Li Shen,et al.  Dimension reduction-based penalized logistic regression for cancer classification using microarray data , 2005, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[27]  D. Kupfer,et al.  Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. , 2006, The American journal of psychiatry.

[28]  Michael Berk,et al.  Application of the Gradient Boosted method in randomised clinical trials: Participant variables that contribute to depression treatment efficacy of duloxetine, SSRIs or placebo. , 2014, Journal of affective disorders.

[29]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[30]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[31]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[32]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[33]  Harlan M. Krumholz,et al.  Reevaluating the Efficacy and Predictability of Antidepressant Treatments: A Symptom Clustering Approach , 2017, JAMA psychiatry.

[34]  Marcia K. Johnson,et al.  Cross-trial prediction of treatment outcome in depression: a machine learning approach. , 2016, The lancet. Psychiatry.

[35]  Roumen Milev,et al.  The Canadian Biomarker Integration Network in Depression (CAN-BIND): advances in response prediction. , 2012, Current pharmaceutical design.

[36]  Kenji Hashimoto,et al.  Personality Traits as Risk Factors for Treatment-Resistant Depression , 2013, PloS one.

[37]  B. Carroll,et al.  ‘Effects of Risperidone Augmentation in Patients with Treatment-Resistant Depression: Results of Open-Label Treatment Followed by Double-Blind Continuation.’ , 2008, Neuropsychopharmacology.

[38]  H Wetzel,et al.  Improving depression severity assessment--I. Reliability, internal validity and sensitivity to change of three observer depression scales. , 1988, Journal of psychiatric research.

[39]  Sidney H. Kennedy,et al.  Measuring the severity of depression and remission in primary care: validation of the HAMD-7 scale , 2005, Canadian Medical Association Journal.

[40]  Quentin J M Huys,et al.  Neural Correlates of Three Promising Endophenotypes of Depression: Evidence from the EMBARC Study , 2016, Neuropsychopharmacology.

[41]  M. Trivedi,et al.  Identifying predictors, moderators, and mediators of antidepressant response in major depressive disorder: neuroimaging approaches. , 2015, The American journal of psychiatry.

[42]  Gustavo Turecki,et al.  What is the meaning of treatment resistant/refractory major depression (TRD)? A systematic review of current randomized trials , 2007, European Neuropsychopharmacology.

[43]  Maurizio Fava,et al.  Brief, unidimensional melancholia rating scales are highly sensitive to the effect of citalopram and may have biological validity: implications for the research domain criteria (RDoC). , 2014, Journal of affective disorders.

[44]  Ruud Boessen,et al.  Comparing HAMD(17) and HAMD subscales on their ability to differentiate active treatment from placebo in randomized controlled trials. , 2013, Journal of affective disorders.

[45]  M H Trivedi,et al.  Factor structure and dimensionality of the two depression scales in STAR*D using level 1 datasets. , 2011, Journal of Affective Disorders.