Disentangled Counterfactual Recurrent Networks for Treatment Effect Inference over Time

Choosing the best treatment-plan for each individual patient requires accurate forecasts of their outcome trajectories as a function of the treatment, over time. While large observational data sets constitute rich sources of information to learn from, they also contain biases as treatments are rarely assigned randomly in practice. To provide accurate and unbiased forecasts, we introduce the Disentangled Counterfactual Recurrent Network (DCRN), a novel sequence-tosequence architecture that estimates treatment outcomes over time by learning representations of patient histories that are disentangled into three separate latent factors: a treatment factor, influencing only treatment selection; an outcome factor, influencing only the outcome; and a confounding factor, influencing both. With an architecture that is completely inspired by the causal structure of treatment influence over time, we advance forecast accuracy and disease understanding, as our architecture allows for practitioners to infer which patient features influence which part in a patient’s trajectory, contrasting other approaches in this domain. We demonstrate that DCRN outperforms current state-of-the-art methods in forecasting treatment responses, on both real and simulated data.

[1]  Suchi Saria,et al.  Learning Treatment-Response Models from Multivariate Longitudinal Data , 2017, UAI.

[2]  S. Eiam‐Ong,et al.  Sepsis-Associated Acute Kidney Injury , 2019, Critical Care Pediatric Nephrology and Dialysis: A Practical Handbook.

[3]  M. Neurath,et al.  Current and emerging therapeutic targets for IBD , 2017, Nature Reviews Gastroenterology & Hepatology.

[4]  Negar Hassanpour,et al.  CounterFactual Regression with Importance Sampling Weights , 2019, IJCAI.

[5]  J. Pittet,et al.  The coagulopathy of acute sepsis , 2015, Current opinion in anaesthesiology.

[6]  Mihaela van der Schaar,et al.  GANITE: Estimation of Individualized Treatment Effects using Generative Adversarial Nets , 2018, ICLR.

[7]  Suchi Saria,et al.  A Bayesian Nonparametic Approach for Estimating Individualized Treatment-Response Curves , 2016, ArXiv.

[8]  Suchi Saria,et al.  Reliable Decision Support using Counterfactual Models , 2017, NIPS.

[9]  Pan Zhou,et al.  Learning Decomposed Representation for Counterfactual Inference , 2020, ArXiv.

[10]  Mark Hoogendoorn,et al.  Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy , 2020, Intensive Care Medicine.

[11]  I. Hambleton,et al.  The Use and Reporting of the Cross-Over Study Design in Clinical Trials and Systematic Reviews: A Systematic Assessment , 2016, PloS one.

[12]  J. Robins Correcting for non-compliance in randomized trials using structural nested mean models , 1994 .

[13]  T. Hifumi,et al.  The SIRS criteria have better performance for predicting infection than qSOFA scores in the emergency department , 2020, Scientific Reports.

[14]  S. West,et al.  Forecasting Causal Effects of Interventions versus Predicting Future Outcomes , 2020, Structural equation modeling : a multidisciplinary journal.

[15]  Mihaela van der Schaar,et al.  Clairvoyance: A Pipeline Toolkit for Medical Time Series , 2023, ICLR.

[16]  Xuelin Huang,et al.  Analysis of multi‐stage treatments for recurrent diseases , 2012, Statistics in medicine.

[17]  Jennifer L. Hill,et al.  Bayesian Nonparametric Modeling for Causal Inference , 2011 .

[18]  Uri Shalit,et al.  Learning Representations for Counterfactual Inference , 2016, ICML.

[19]  Arthur Lewbel,et al.  The Identification Zoo: Meanings of Identification in Econometrics , 2019 .

[20]  Stefan Wager,et al.  Estimation and Inference of Heterogeneous Treatment Effects using Random Forests , 2015, Journal of the American Statistical Association.

[21]  Keith R. Walley,et al.  Hyperchloremia and moderate increase in serum chloride are associated with acute kidney injury in severe sepsis and septic shock patients , 2016, Critical Care.

[22]  Peter Szolovits,et al.  MIMIC-III, a freely accessible critical care database , 2016, Scientific Data.

[23]  Negar Hassanpour,et al.  Learning Disentangled Representations for CounterFactual Regression , 2020, ICLR.

[24]  Vittorio Cristini,et al.  Mathematical prediction of clinical outcomes in advanced cancer patients treated with checkpoint inhibitor immunotherapy , 2020, Science Advances.

[25]  Bryan Lim,et al.  Forecasting Treatment Responses Over Time Using Recurrent Marginal Structural Networks , 2018, NeurIPS.

[26]  Aidong Zhang,et al.  Representation Learning for Treatment Effect Estimation from Observational Data , 2018, NeurIPS.

[27]  Jeroen Berrevoets,et al.  OrganITE: Optimal transplant donor organ offering using an individual treatment effect , 2020, NeurIPS.

[28]  P. Charles,et al.  Predicting outcome in patients with sepsis: new biomarkers for old expectations , 2014, Critical Care.

[29]  M. Robins James,et al.  Estimation of the causal effects of time-varying exposures , 2008 .

[30]  N. Jones,et al.  Diagnosis and management of hypertension in adults: NICE guideline update 2019. , 2020, The British journal of general practice : the journal of the Royal College of General Practitioners.

[31]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[32]  M. Hashem Pesaran,et al.  Impulse response analysis in nonlinear multivariate models , 1996 .

[33]  Uri Shalit,et al.  Estimating individual treatment effect: generalization bounds and algorithms , 2016, ICML.

[34]  Sangeeta Mehta,et al.  Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock: 2016 , 2017, Intensive Care Medicine.

[35]  S. Han,et al.  An increased chloride level in hypochloremia is associated with decreased mortality in patients with severe sepsis or septic shock , 2017, Scientific Reports.

[36]  J. Kellum,et al.  Acute kidney injury from sepsis: current concepts, epidemiology, pathophysiology, prevention and treatment. , 2019, Kidney international.

[37]  Michael J Daniels,et al.  A Bayesian nonparametric approach to marginal structural models for point treatments and a continuous or survival outcome. , 2017, Biostatistics.

[38]  J. Vincent,et al.  The Clinical Challenge of Sepsis Identification and Monitoring , 2016, PLoS medicine.

[39]  Haniye Sadat Sajadi,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017 , 2018, The Lancet.

[40]  N. Kaplan Clinical trials for hypertension: expectations fulfilled and unfulfilled. , 2007, Hypertension.

[41]  C Roberts,et al.  Understanding controlled trials Crossover trials , 1998, BMJ.

[42]  Bo Li,et al.  Treatment Effect Estimation with Data-Driven Variable Decomposition , 2017, AAAI.

[43]  Mihaela van der Schaar,et al.  Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representations , 2020, ICLR.

[44]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[45]  Mihaela van der Schaar,et al.  Limits of Estimating Heterogeneous Treatment Effects: Guidelines for Practical Algorithm Design , 2018, ICML.

[46]  M. Parkes,et al.  Personalised medicine in Crohn's disease. , 2020, The lancet. Gastroenterology & hepatology.

[47]  Yao Zhang,et al.  Learning Overlapping Representations for the Estimation of Individualized Treatment Effects , 2020, AISTATS.