Sample Size Requirements for Multivariate Models to Predict Between-Patient Differences in Best Treatments of Major Depressive Disorder

Clinical trials have documented numerous clinical features, social characteristics, and biomarkers that are “prescriptive” predictors of depression treatment response, that is, predictors of which types of treatments are best for which patients. On the basis of these results, research is actively under way to develop multivariate prescriptive prediction models to guide precision depression treatment planning. However, the sample size requirements for such models have not been analyzed. We present such an analysis here. Simulations using realistic parameter values and a state-of-the-art cross-validated targeted minimum loss-based prescription treatment response estimator show that at least 300 patients per treatment arm are needed to have adequate statistical power to detect clinically significant underlying marginal improvements in treatment response because of precision treatment selection. This is a considerably larger sample size than in most existing studies. We close with a discussion of practical study design options to address the need for larger sample sizes in future studies.

[1]  Maurizio Fava,et al.  Bupropion-SR, sertraline, or venlafaxine-XR after failure of SSRIs for depression. , 2006, The New England journal of medicine.

[2]  R. DeRubeis,et al.  Treatment Selection in Depression. , 2018, Annual review of clinical psychology.

[3]  M. Hamilton A RATING SCALE FOR DEPRESSION , 1960, Journal of neurology, neurosurgery, and psychiatry.

[4]  I. Lipkovich,et al.  Tutorial in biostatistics: data‐driven subgroup identification and analysis in clinical trials , 2017, Statistics in medicine.

[5]  L. Bero,et al.  Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. , 2014, The Cochrane database of systematic reviews.

[6]  M. Trivedi,et al.  Evidence-Based Recommendations for the Prescription of Exercise for Major Depressive Disorder , 2013, Journal of psychiatric practice.

[7]  M. J. van der Laan,et al.  The International Journal of Biostatistics Targeted Maximum Likelihood Learning , 2011 .

[8]  P. Muglia,et al.  Genome-wide pharmacogenetics of antidepressant response in the GENDEP project. , 2010, The American journal of psychiatry.

[9]  Zachary D. Cohen,et al.  The Personalized Advantage Index: Translating Research on Prediction into Individualized Treatment Recommendations. A Demonstration , 2014, PloS one.

[10]  P. Llorca,et al.  Investigational drugs in recent clinical trials for treatment-resistant depression , 2017, Expert review of neurotherapeutics.

[11]  Mark J van der Laan,et al.  Targeted Learning of the Mean Outcome under an Optimal Dynamic Treatment Rule , 2015, Journal of causal inference.

[12]  P. Cuijpers,et al.  Effectiveness of a Web-Based Guided Self-help Intervention for Outpatients With a Depressive Disorder: Short-term Results From a Randomized Controlled Trial , 2016, Journal of medical Internet research.

[13]  R. Kessler,et al.  Undertreatment of people with major depressive disorder in 21 countries , 2017, British Journal of Psychiatry.

[14]  C. Nemeroff,et al.  Personalized medicine: Prediction of disease vulnerability in mood disorders , 2016, Neuroscience Letters.

[15]  Alan Frazer,et al.  Vagal Nerve Stimulation for Treatment-Resistant Depression , 2017, Neurotherapeutics.

[16]  Ashutosh Kumar Singh,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015 , 2016, Lancet.

[17]  D. Kupfer,et al.  Background and rationale for the sequenced treatment alternatives to relieve depression (STAR*D) study. , 2003, The Psychiatric clinics of North America.

[18]  Erin LeDell,et al.  Super Learner Analysis of Electronic Adherence Data Improves Viral Prediction and May Provide Strategies for Selective HIV RNA Monitoring , 2015, Journal of acquired immune deficiency syndromes.

[19]  R. Kessler The costs of depression. , 2012, The Psychiatric clinics of North America.

[20]  J. Lurie,et al.  Pros and cons of pragmatic clinical trials. , 2013, Journal of comparative effectiveness research.

[21]  Ian Roberts,et al.  Systematic review of prognostic models in traumatic brain injury , 2006, BMC Medical Informatics Decis. Mak..

[22]  Stuart J Pocock,et al.  The science of risk models , 2012, European journal of preventive cardiology.

[23]  M. Pencina,et al.  Graphical assessment of incremental value of novel markers in prediction models: From statistical to decision analytical perspectives , 2014, Biometrical journal. Biometrische Zeitschrift.

[24]  Roumen Milev,et al.  The Canadian Biomarker Integration Network in Depression (CAN-BIND): advances in response prediction. , 2012, Current pharmaceutical design.

[25]  P. Saltiel,et al.  Major depressive disorder: mechanism-based prescribing for personalized medicine , 2015, Neuropsychiatric disease and treatment.

[26]  Arnoud Arntz,et al.  Predicting Optimal Outcomes in Cognitive Therapy or Interpersonal Psychotherapy for Depressed Individuals Using the Personalized Advantage Index Approach , 2015, PloS one.

[27]  Alan E Hubbard,et al.  Simulation methods to estimate design power: an overview for applied research , 2011, BMC medical research methodology.

[28]  G. Andersson,et al.  Are psychological and pharmacologic interventions equally effective in the treatment of adult depressive disorders? A meta-analysis of comparative studies. , 2008, The Journal of clinical psychiatry.

[29]  W. Brown,et al.  Antidepressants versus placebo in major depression: an overview , 2015, World psychiatry : official journal of the World Psychiatric Association.

[30]  D. Kupfer,et al.  Acute and Longer- Term Outcomes in Depressed Outpatients Requiring One or Several Treatment Steps: A STAR*D Report , 2006 .

[31]  L. Erin,et al.  AUC-Maximizing Ensembles through Metalearning , 2016 .

[32]  R. Kessler The potential of predictive analytics to provide clinical decision support in depression treatment planning , 2018, Current opinion in psychiatry.

[33]  H. Kraemer,et al.  Establishing moderators and biosignatures of antidepressant response in clinical care (EMBARC): Rationale and design. , 2016, Journal of psychiatric research.

[34]  T. Vos,et al.  Global variation in the prevalence and incidence of major depressive disorder: a systematic review of the epidemiological literature , 2012, Psychological Medicine.

[35]  Ying Lu,et al.  Evaluating the improvement in diagnostic utility from adding new predictors , 2010, Biometrical journal. Biometrische Zeitschrift.

[36]  Helen S Mayberg,et al.  Predictors of remission in depression to individual and combined treatments (PReDICT): study protocol for a randomized controlled trial , 2012, Trials.

[37]  Eric B. Laber,et al.  Inference about the expected performance of a data-driven dynamic treatment regime , 2014, Clinical trials.

[38]  J. Hibbard,et al.  How well do patient activation scores predict depression outcomes one year later? , 2014, Journal of Affective Disorders.

[39]  S Greenland,et al.  Tests for interaction in epidemiologic studies: a review and a study of power. , 1983, Statistics in medicine.

[40]  S. Wisniewski,et al.  International Study to Predict Optimized Treatment for Depression (iSPOT-D), a randomized clinical trial: rationale and protocol , 2011, Trials.

[41]  R. Kessler,et al.  Using patient self-reports to study heterogeneity of treatment effects in major depressive disorder , 2016, Epidemiology and Psychiatric Sciences.

[42]  C. Durand Does Raising Type 1 Error Rate Improve Power to Detect Interactions in Linear Regression Models? A Simulation Study , 2013, PloS one.

[43]  M. J. van der Laan,et al.  Super-Learning of an Optimal Dynamic Treatment Rule , 2016, The international journal of biostatistics.

[44]  Christine Stewart,et al.  Health Care Contacts in the Year Before Suicide Death , 2014, Journal of General Internal Medicine.

[45]  E. Isometsä,et al.  Pharmacological and psychosocial treatment of depression in primary care: Low intensity and poor adherence and continuity. , 2016, Journal of affective disorders.

[46]  M. J. van der Laan,et al.  STATISTICAL INFERENCE FOR THE MEAN OUTCOME UNDER A POSSIBLY NON-UNIQUE OPTIMAL TREATMENT STRATEGY. , 2016, Annals of statistics.

[47]  Ewout W Steyerberg,et al.  Estimating treatment effects for individual patients based on the results of randomised clinical trials , 2011, BMJ : British Medical Journal.

[48]  G. Andersson,et al.  Time to remission from mild to moderate depressive symptoms: One year results from the EVIDENT-study, an RCT of an internet intervention for depression. , 2017, Behaviour research and therapy.

[49]  R. Todd Ogden,et al.  Statistical analysis plan for stage 1 EMBARC (Establishing Moderators and Biosignatures of Antidepressant Response for Clinical Care) study , 2017, Contemporary clinical trials communications.

[50]  Stephanie Kovalchik,et al.  Assessing heterogeneity of treatment effect in a clinical trial with the proportional interactions model , 2013, Statistics in medicine.

[51]  M. Arns,et al.  Personalized Medicine: Review and Perspectives of Promising Baseline EEG Biomarkers in Major Depressive Disorder and Attention Deficit Hyperactivity Disorder , 2016, Neuropsychobiology.

[52]  R. DeRubeis,et al.  Personalized prediction of antidepressant v. placebo response: evidence from the EMBARC study , 2018, Psychological Medicine.

[53]  W. E. Craighead,et al.  Combination psychotherapy and antidepressant medication treatment for depression: for whom, when, and how. , 2014, Annual review of psychology.

[54]  M. J. van der Laan,et al.  Statistical Applications in Genetics and Molecular Biology Super Learner , 2010 .

[55]  S. Rose Mortality risk score prediction in an elderly population using machine learning. , 2013, American journal of epidemiology.

[56]  P. A. Bradley,et al.  Developing a practical suicide risk prediction model for targeting high‐risk patients in the Veterans health Administration , 2017, International journal of methods in psychiatric research.

[57]  M. J. van der Laan,et al.  Mortality prediction in intensive care units with the Super ICU Learner Algorithm (SICULA): a population-based study. , 2015, The Lancet. Respiratory medicine.

[58]  Ellen Frank,et al.  A novel approach for developing and interpreting treatment moderator profiles in randomized clinical trials. , 2013, JAMA psychiatry.

[59]  Richard Dobson,et al.  A comparison of machine learning methods for classification using simulation with multiple real data examples from mental health studies , 2013, Statistical methods in medical research.

[60]  T. Friede,et al.  Methods for identification and confirmation of targeted subgroups in clinical trials: A systematic review , 2016, Journal of biopharmaceutical statistics.

[61]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[62]  K. Jolly,et al.  A randomised controlled trial of the effectiveness of self-weighing as a weight loss intervention , 2014, International Journal of Behavioral Nutrition and Physical Activity.

[63]  D. Wasserman,et al.  Psychiatric diagnoses and suicide: revisiting the evidence. , 2004, Crisis.

[64]  A. Serretti,et al.  Progress and prospects in pharmacogenetics of antidepressant drugs , 2016, Expert opinion on drug metabolism & toxicology.

[65]  Gregory M. Garrison,et al.  Time to Remission for Depression with Collaborative Care Management (CCM) in Primary Care , 2016, The Journal of the American Board of Family Medicine.

[66]  K. Hirano,et al.  Impossibility Results for Nondifferentiable Functionals , 2012 .

[67]  A. Franco,et al.  Toward a neuroimaging treatment selection biomarker for major depressive disorder. , 2013, JAMA psychiatry.

[68]  James M. Robins,et al.  Optimal Structural Nested Models for Optimal Sequential Decisions , 2004 .