Application of causal inference methods in the analyses of randomised controlled trials: a systematic review

BackgroundApplications of causal inference methods to randomised controlled trial (RCT) data have usually focused on adjusting for compliance with the randomised intervention rather than on using RCT data to address other, non-randomised questions. In this paper we review use of causal inference methods to assess the impact of aspects of patient management other than the randomised intervention in RCTs.MethodsWe identified papers that used causal inference methodology in RCT data from Medline, Premedline, Embase, Cochrane Library, and Web of Science from 1986 to September 2014, using a forward citation search of five seminal papers, and a keyword search. We did not include studies where inverse probability weighting was used solely to balance baseline characteristics, adjust for loss to follow-up or adjust for non-compliance to randomised treatment. Studies where the exposure could not be assigned were also excluded.ResultsThere were 25 papers identified. Nearly half the papers (11/25) estimated the causal effect of concomitant medication on outcome. The remainder were concerned with post-randomisation treatment regimens (sequential treatments, n =5 ), effects of treatment timing (n = 2) and treatment dosing or duration (n = 7). Examples were found in cardiovascular disease (n = 5), HIV (n = 7), cancer (n = 6), mental health (n = 4), paediatrics (n = 2) and transfusion medicine (n = 1). The most common method implemented was a marginal structural model with inverse probability of treatment weighting.ConclusionsExamples of studies which exploit RCT data to address non-randomised questions using causal inference methodology remain relatively limited, despite the growth in methodological development and increasing utilisation in observational studies. Further efforts may be needed to promote use of causal methods to address additional clinical questions within RCTs to maximise their value.

[1]  J. Robins A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect , 1986 .

[2]  J. Robins,et al.  Correcting for non-compliance in randomized trials using rank preserving structural failure time models , 1991 .

[3]  J. Robins,et al.  Recovery of Information and Adjustment for Dependent Censoring Using Surrogate Markers , 1992 .

[4]  J. Robins,et al.  G-Estimation of the Effect of Prophylaxis Therapy for Pneumocystis carinii Pneumonia on the Survival of AIDS Patients , 1992, Epidemiology.

[5]  J. Robins Correcting for non-compliance in randomized trials using structural nested mean models , 1994 .

[6]  J. Robins,et al.  Adjusting for differential rates of prophylaxis therapy for PCP in high- versus low-dose AZT treatment arms in an AIDS randomized trial , 1994 .

[7]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[8]  James M. Robins,et al.  Marginal Structural Models versus Structural nested Models as Tools for Causal inference , 2000 .

[9]  J. Robins,et al.  Correcting for Noncompliance and Dependent Censoring in an AIDS Clinical Trial with Inverse Probability of Censoring Weighted (IPCW) Log‐Rank Tests , 2000, Biometrics.

[10]  J. Robins,et al.  Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. , 2000, Epidemiology.

[11]  J. Robins,et al.  Marginal Structural Models to Estimate the Joint Causal Effect of Nonrandomized Treatments , 2001 .

[12]  J M Robins,et al.  Marginal Mean Models for Dynamic Regimes , 2001, Journal of the American Statistical Association.

[13]  J. Robins,et al.  Estimating the causal effect of zidovudine on CD4 count with a marginal structural model for repeated measures , 2002, Statistics in medicine.

[14]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[15]  Y. Ohashi,et al.  Adjusting for differential proportions of second‐line treatment in cancer clinical trials. Part II: An application in a clinical trial of unresectable non‐small‐cell lung cancer , 2004, Statistics in medicine.

[16]  James M. Robins,et al.  Optimal Structural Nested Models for Optimal Sequential Decisions , 2004 .

[17]  James M. Robins,et al.  Association, Causation, And Marginal Structural Models , 1999, Synthese.

[18]  E. Goetghebeur,et al.  Structural accelerated failure time models for the effects of observed exposures on repeated events in a clinical trial , 2005, Statistics in medicine.

[19]  J. Robins,et al.  Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/pds.1064 , 2022 .

[20]  Marshall M Joffe,et al.  History-Adjusted Marginal Structural Models and Statically-Optimal Dynamic Treatment Regimens , 2005 .

[21]  M. J. van der Laan,et al.  The International Journal of Biostatistics Causal Effect Models for Realistic Individualized Treatment and Intention to Treat Rules , 2011 .

[22]  S. Fuchs,et al.  Postnatal depression in Southern Brazil: prevalence and its demographic and socioeconomic determinants , 2008, BMC psychiatry.

[23]  James M. Robins,et al.  Observational Studies Analyzed Like Randomized Experiments: An Application to Postmenopausal Hormone Therapy and Coronary Heart Disease , 2008, Epidemiology.

[24]  Serena J Counsell,et al.  Evidence from in vivo 31-phosphorus magnetic resonance spectroscopy phosphodiesters that exhaled ethane is a biomarker of cerebral n-3 polyunsaturated fatty acid peroxidation in humans , 2008, BMC psychiatry.

[25]  I. Lipkovich,et al.  Evaluating dose response from flexible dose clinical trials , 2008, BMC psychiatry.

[26]  Stephen R Cole,et al.  Constructing inverse probability weights for marginal structural models. , 2008, American journal of epidemiology.

[27]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[28]  N. Jewell,et al.  Analysing direct effects in randomized trials with secondary interventions: an application to human immunodeficiency virus prevention trials , 2009 .

[29]  M. Kramer,et al.  Estimating Response-Maximized Decision Rules With Applications to Breastfeeding , 2009 .

[30]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[31]  James M Robins,et al.  Estimating Absolute Risks in the Presence of Nonadherence: An Application to a Follow-up Study With Baseline Randomization , 2010, Epidemiology.

[32]  C. Gilks,et al.  Daily co-trimoxazole prophylaxis in severely immunosuppressed HIV-infected adults in Africa started on combination antiretroviral therapy: an observational analysis of the DART cohort , 2010, The Lancet.

[33]  B. Brumback,et al.  Phase II randomized comparison of topotecan plus cyclophosphamide versus topotecan alone in children with recurrent or refractory neuroblastoma: a Children's Oncology Group study. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[34]  James M. Robins,et al.  The International Journal of Biostatistics CAUSAL INFERENCE When to Start Treatment ? A Systematic Approach to the Comparison of Dynamic Regimes Using Observational Data , 2011 .

[35]  A. Young,et al.  In search of optimal lithium levels and olanzapine doses in the long-term treatment of bipolar I disorder. A post-hoc analysis of the maintenance study by Tohen et al. 2005 , 2010, European Psychiatry.

[36]  T. Schuster,et al.  Post-study therapy as a source of confounding in survival analysis of first-line studies in patients with advanced non-small-cell lung cancer. , 2011, Journal of thoracic disease.

[37]  Eric M. Reyes,et al.  Abstract 14642: Do Diuretics, Beta-Blockers, and Statins Increase the Risk of Diabetes in Patients with Impaired Glucose Tolerance? Insights from the NAVIGATOR Study , 2012 .

[38]  Peter F Thall,et al.  Evaluation of Viable Dynamic Treatment Regimes in a Sequentially Randomized Trial of Advanced Prostate Cancer , 2012, Journal of the American Statistical Association.

[39]  E. Porrini,et al.  Renin-angiotensin system blockade and kidney transplantation: a longitudinal cohort study. , 2012, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[40]  S. Cole,et al.  Marginal structural models for case-cohort study designs to estimate the association of antiretroviral therapy initiation with incident AIDS or death. , 2012, American journal of epidemiology.

[41]  Y. Ohashi,et al.  Effective prevention of cardiovascular disease and diabetes‐related events with atorvastatin in Japanese elderly patients with type 2 diabetes mellitus: Adjusting for treatment changes using a marginal structural proportional hazards model and a rank‐preserving structural failure time model , 2012, Geriatrics & gerontology international.

[42]  Li-sheng Liu,et al.  Higher cardiovascular risk and impaired benefit of antihypertensive treatment in hypertensive patients requiring additional drugs on top of randomized therapy: is adding drugs always beneficial? , 2012, Journal of hypertension.

[43]  C. Morrison,et al.  Hormonal contraception and the risk of HIV acquisition among women in South Africa , 2012, AIDS.

[44]  Y. Yoshimasa,et al.  Effects of voglibose and nateglinide on glycemic status and coronary atherosclerosis in early-stage diabetic patients. , 2012, Circulation journal : official journal of the Japanese Circulation Society.

[45]  Min Zhang,et al.  Estimating treatment effects from a randomized clinical trial in the presence of a secondary treatment. , 2012, Biostatistics.

[46]  Brent A. Johnson,et al.  Evaluating the Effect of Early Versus Late ARV Regimen Change if Failure on an Initial Regimen: Results From the AIDS Clinical Trials Group Study A5095 , 2012, Journal of the American Statistical Association.

[47]  N. Keiding,et al.  Estimation of dynamic treatment strategies for maintenance therapy of children with acute lymphoblastic leukaemia: an application of history‐adjusted marginal structural models , 2012, Statistics in medicine.

[48]  Peter Diem,et al.  Role of diuretics, β blockers, and statins in increasing the risk of diabetes in patients with impaired glucose tolerance: reanalysis of data from the NAVIGATOR study , 2013, BMJ.

[49]  Abdus S Wahed,et al.  Evaluating joint effects of induction–salvage treatment regimes on overall survival in acute leukaemia , 2013, Journal of the Royal Statistical Society. Series C, Applied statistics.

[50]  I. White,et al.  Review of inverse probability weighting for dealing with missing data , 2013, Statistical methods in medical research.

[51]  R. Cook,et al.  Inverse probability weighted estimating equations for randomized trials in transfusion medicine , 2013, Statistics in medicine.

[52]  A. van der Straten,et al.  Oral and injectable contraception use and risk of HIV acquisition among women in sub-Saharan Africa , 2013, AIDS.

[53]  Stephen R Cole,et al.  An information criterion for marginal structural models , 2013, Statistics in medicine.

[54]  B L De Stavola,et al.  Methods for dealing with time‐dependent confounding , 2013, Statistics in medicine.

[55]  Min Zhang,et al.  Adjusting for observational secondary treatments in estimating the effects of randomized treatments. , 2013, Biostatistics.

[56]  J. Robins Structural Nested Failure Time Models , 2005 .

[57]  D. Atar,et al.  Apixaban vs. warfarin with concomitant aspirin in patients with atrial fibrillation: insights from the ARISTOTLE trial. , 2014, European heart journal.

[58]  J. Calabrese,et al.  Effect of adjunctive benzodiazepines on clinical outcomes in lithium- or quetiapine-treated outpatients with bipolar I or II disorder: results from the Bipolar CHOICE trial. , 2014, Journal of affective disorders.

[59]  Peter Diem,et al.  Role of diuretics, β blockers, and statins in increasing the risk of diabetes in patients with impaired glucose tolerance: reanalysis of data from the NAVIGATOR study , 2014, BMJ : British Medical Journal.

[60]  A. Crook,et al.  Injectable and oral contraceptives and risk of HIV acquisition in women: an analysis of data from the MDP301 trial , 2014, Human reproduction.

[61]  The Impact of Different CD4 Cell-Count Monitoring and Switching Strategies on Mortality in HIV-Infected African Adults on Antiretroviral Therapy: An Application of Dynamic Marginal Structural Models , 2015, American journal of epidemiology.

[62]  Edward H Kennedy,et al.  An introduction to g methods. , 2016, International journal of epidemiology.