Maximizing Intervention Effectiveness

Frequently, policymakers seek to roll out an intervention previously proven effective in a research study, perhaps subject to resource constraints. However, since different subpopulations may respond differently to the same treatment, there is no a priori guarantee that the intervention will be as effective in the targeted population as it was in the study. How then should policymakers target individuals to maximize intervention effectiveness? We propose a novel robust optimization approach that leverages evidence typically available in a published study. Our approach is tractable -- real-world instances are easily optimized in minutes with off-the-shelf software -- and flexible enough to accommodate a variety of resource and fairness constraints. We compare our approach with current practice by proving tight, performance guarantees for both approaches which emphasize their structural differences. We also prove an intuitive interpretation of our model in terms of regularization, penalizing differences in the demographic distribution between targeted individuals and the study population. Although the precise penalty depends on the choice of uncertainty set, we show for special cases that we can recover classical penalties from the covariate matching literature on causal inference. Finally, using real data from a large teaching hospital, we compare our approach to current practice in the particular context of reducing emergency department utilization by Medicaid patients through case management. We find that our approach can offer significant benefits over current practice, particularly when the heterogeneity in patient response to the treatment is large.

[1]  Jean-Philippe Vial,et al.  Deriving robust counterparts of nonlinear uncertain inequalities , 2012, Math. Program..

[2]  P. Holland Statistics and Causal Inference , 1985 .

[3]  Anja De Waegenaere,et al.  Robust Solutions of Optimization Problems Affected by Uncertain Probabilities , 2011, Manag. Sci..

[4]  Catherine P. Bradshaw,et al.  The use of propensity scores to assess the generalizability of results from randomized trials , 2011, Journal of the Royal Statistical Society. Series A,.

[5]  Alison L Gibbs,et al.  On Choosing and Bounding Probability Metrics , 2002, math/0209021.

[6]  Nathan Kallus,et al.  Recursive Partitioning for Personalization using Observational Data , 2016, ICML.

[7]  Susan M. Dynarski,et al.  Into College, Out of Poverty? Policies to Increase the Postsecondary Attainment of the Poor , 2009 .

[8]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[9]  Keon-Hyung Lee,et al.  Can Case Management Interventions Reduce the Number of Emergency Department Visits by Frequent Users? , 2006, The health care manager.

[10]  C. Steiner,et al.  Comorbidity measures for use with administrative data. , 1998, Medical care.

[11]  Stephen Relyea,et al.  An Analytics Approach to Designing Combination Chemotherapy Regimens for Cancer , 2016, Manag. Sci..

[12]  T. Weiland,et al.  The effect of multidisciplinary case management on selected outcomes for frequent attenders at an emergency department , 2006, The Medical journal of Australia.

[13]  Zuo-Jun Max Shen,et al.  Robust Defibrillator Deployment Under Cardiac Arrest Location Uncertainty via Row-and-Column Generation , 2015, Oper. Res..

[14]  S. Cole,et al.  Generalizing evidence from randomized clinical trials to target populations: The ACTG 320 trial. , 2010, American journal of epidemiology.

[15]  Kumar Rajaram,et al.  Planning for HIV Screening, Testing, and Care at the Veterans Health Administration , 2015, Oper. Res..

[16]  Nina S. Parikh,et al.  Emergency department use in New York City: a substitute for primary care? , 2000, Issue brief.

[17]  Dimitris Bertsimas,et al.  Optimal healthcare decision making under multiple mathematical models: application in prostate cancer screening , 2016, Health care management science.

[18]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[19]  K. O'Brien,et al.  Cost-effectiveness of clinical case management for ED frequent users: results of a randomized trial. , 2008, The American journal of emergency medicine.

[20]  Mohsen Bayati,et al.  Online Decision-Making with High-Dimensional Covariates , 2015 .

[21]  S. Zuckerman,et al.  Trends in Medicaid physician fees, 2003-2008. , 2009, Health affairs.

[22]  Marc Ratkovic,et al.  Estimating treatment effect heterogeneity in randomized program evaluation , 2013, 1305.5682.

[23]  Melvyn Sim,et al.  Adjustable Robust Optimization via Fourier-Motzkin Elimination , 2018, Oper. Res..

[24]  Dimitris Bertsimas,et al.  Characterization of the equivalence of robustification and regularization in linear and matrix regression , 2017, Eur. J. Oper. Res..

[25]  Stefan Wager,et al.  Efficient Policy Learning , 2017, ArXiv.

[26]  Margaret L. Brandeau,et al.  Dynamic Learning of Patient Response Types: An Application to Treating Chronic Diseases , 2017, Manag. Sci..

[27]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.

[28]  Laurent El Ghaoui,et al.  Robust Solutions to Least-Squares Problems with Uncertain Data , 1997, SIAM J. Matrix Anal. Appl..

[29]  E. L. García,et al.  Assessment of an after-school physical activity program to prevent obesity among 9- to 10-year-old children: a cluster randomized trial , 2008, International Journal of Obesity.

[30]  David Simchi-Levi,et al.  A Practically Competitive and Provably Consistent Algorithm for Uplift Modeling , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[31]  L. Pardo Statistical Inference Based on Divergence Measures , 2005 .

[32]  Eva Ascarza Retention Futility: Targeting High-Risk Customers Might be Ineffective , 2018 .

[33]  David Moore,et al.  Data Uncertainty in Markov Chains: Application to Cost-Effectiveness Analyses of Medical Innovations , 2018, Oper. Res..

[34]  J. Sekhon,et al.  From SATE to PATT : Combining Experimental with Observational Studies to Estimate Population Treatment Effects ∗ , 2013 .

[35]  Maria C Raven,et al.  Dispelling an urban legend: frequent emergency department users have substantial burden of disease. , 2013, Health affairs.

[36]  Reema Shah,et al.  Evaluation of Care Management for the Uninsured , 2011, Medical care.

[37]  A. Breckenridge,et al.  Open Clinical Trial Data for All? A View from Regulators , 2012, PLoS medicine.

[38]  Melvyn Sim,et al.  Satisficing Measures for Analysis of Risky Positions , 2009, Manag. Sci..

[39]  John N. Tsitsiklis,et al.  Robust Management of Motion Uncertainty in Intensity-Modulated Radiation Therapy , 2008, Oper. Res..

[40]  Leandro Pardo Llorente Statistical inference based on divergence measures , 2005 .

[41]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[42]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[43]  Timothy C. Y. Chan,et al.  Optimizing the Deployment of Public Access Defibrillators , 2016, Manag. Sci..

[44]  Nikolaos Trichakis,et al.  Pareto Efficiency in Robust Optimization , 2014, Manag. Sci..

[45]  Daniel Kuhn,et al.  Primal and dual linear decision rules in stochastic and robust optimization , 2011, Math. Program..

[46]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[47]  Shie Mannor,et al.  Robustness and Regularization of Support Vector Machines , 2008, J. Mach. Learn. Res..

[48]  Jean-Philippe Vial,et al.  Robust Optimization , 2021, ICORES.

[49]  Pierre Gutierrez,et al.  Causal Inference and Uplift Modelling: A Review of the Literature , 2017, PAPIs.

[50]  Henry Lam,et al.  Robust Sensitivity Analysis for Stochastic Systems , 2013, Math. Oper. Res..