Treatment Allocation under Uncertain Costs

We consider the problem of learning how to optimally allocate treatments whose cost is uncertain and can vary with pre-treatment covariates. This setting may arise in medicine if we need to prioritize access to a scarce resource that different patients would use for different amounts of time, or in marketing if we want to target discounts whose cost to the company depends on how much the discounts are used. Here, we derive the form of the optimal treatment allocation rule under budget constraints, and propose a practical random forest based method for learning a treatment rule using data from a randomized trial or, more broadly, unconfounded data. Our approach leverages a statistical connection between our problem and that of learning heterogeneous treatment effects under endogeneity using an instrumental variable. We find our method to exhibit promising empirical performance both in simulations and in a marketing application.

[1]  Haoda Fu,et al.  Learning Optimal Personalized Treatment Rules in Consideration of Benefit and Risk: With an Application to Treating Type 2 Diabetes Patients With Insulin Therapies , 2018, Journal of the American Statistical Association.

[2]  Kosuke Imai,et al.  Experimental Evaluation of Individualized Treatment Rules , 2019, Journal of the American Statistical Association.

[3]  P. Holland Statistics and Causal Inference , 1985 .

[4]  B. Efron,et al.  The Jackknife: The Bootstrap and Other Resampling Plans. , 1983 .

[5]  S. Athey,et al.  Generalized random forests , 2016, The Annals of Statistics.

[6]  B. Efron The jackknife, the bootstrap, and other resampling plans , 1987 .

[7]  Cynthia Rudin,et al.  Learning Cost-Effective and Interpretable Treatment Regimes , 2017, AISTATS.

[8]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[9]  Sören R. Künzel,et al.  Metalearners for estimating heterogeneous treatment effects using machine learning , 2017, Proceedings of the National Academy of Sciences.

[10]  Jun Li,et al.  An Instrumental Variable Forest Approach for Detecting Heterogeneous Treatment Effects in Observational Studies , 2018, Manag. Sci..

[11]  Dan Roth,et al.  Learning cost-sensitive active classifiers , 2002, Artif. Intell..

[12]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1994 .

[13]  Eva Ascarza Retention Futility: Targeting High-Risk Customers Might be Ineffective , 2018 .

[14]  Szymon Jaroszewicz,et al.  Decision trees for uplift modeling with single and multiple treatments , 2011, Knowledge and Information Systems.

[15]  Jin Xu,et al.  Estimating individualized treatment rules with risk constraint , 2020, Biometrics.

[16]  Mark J van der Laan,et al.  Optimal Individualized Treatments in Resource-Limited Settings , 2016, The international journal of biostatistics.

[17]  Zhengyuan Zhou,et al.  Offline Multi-Action Policy Learning: Generalization and Optimization , 2018, Oper. Res..

[18]  S. Athey,et al.  Estimating Treatment Effects with Causal Forests: An Application , 2019, Observational Studies.

[19]  Dimitris Bertsimas,et al.  Optimal Prescriptive Trees , 2019, INFORMS J. Optim..

[20]  Stefan Wager,et al.  Estimation and Inference of Heterogeneous Treatment Effects using Random Forests , 2015, Journal of the American Statistical Association.

[21]  P. Richard Hahn,et al.  Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects , 2017, 1706.09523.

[22]  Toru Kitagawa,et al.  Who should be Treated? Empirical Welfare Maximization Methods for Treatment Choice , 2015 .

[23]  Sunil Gupta,et al.  Managing Churn to Maximize Profits , 2020, Mark. Sci..

[24]  F. Sheikh Poor Economics: A Radical Rethinking of the Way to Fight Global Poverty , 2017 .

[25]  James Durbin,et al.  Errors in variables , 1954 .

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[28]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[29]  Lu Tian,et al.  Effectively Selecting a Target Population for a Future Comparative Study , 2013, Journal of the American Statistical Association.

[30]  Xinkun Nie,et al.  Quasi-oracle estimation of heterogeneous treatment effects , 2017, Biometrika.

[31]  Alberto Abadie Semiparametric instrumental variable estimation of treatment response models , 2003 .

[32]  Ron Kohavi,et al.  Controlled experiments on the web: survey and practical guide , 2009, Data Mining and Knowledge Discovery.

[33]  A. Briggs,et al.  Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. , 2002, Health economics.

[34]  Song-Hee Kim,et al.  Maximizing Intervention Effectiveness , 2017, Manag. Sci..

[35]  Yizhe Xu,et al.  Estimating the optimal individualized treatment rule from a cost‐effectiveness perspective , 2020, Biometrics.

[36]  Edward H. Kennedy Optimal doubly robust estimation of heterogeneous causal effects , 2020, 2004.14497.

[37]  Sanjay Basu,et al.  Detecting Heterogeneous Treatment Effects to Guide Personalized Blood Pressure Treatment , 2017, Annals of Internal Medicine.

[38]  Donglin Zeng,et al.  Estimating Individualized Treatment Rules Using Outcome Weighted Learning , 2012, Journal of the American Statistical Association.

[39]  A. Banerjee,et al.  Thinking Small: A Review of Poor Economics: A Radical Rethinking of the Way to Fight Global Poverty , 2016 .

[40]  G. Dantzig Discrete-Variable Extremum Problems , 1957 .

[41]  Nathan Kallus,et al.  Confounding-Robust Policy Improvement , 2018, NeurIPS.