Performance of principal scores to estimate the marginal compliers causal effect of an intervention

We examine the properties of principal scores methods to estimate the causal marginal odds ratio of an intervention for compliers in the context of a randomized controlled trial with non-compliers. The two-stage estimation approach has been proposed for a linear model by Jo and Stuart (Statistics in Medicine 2009; 28:2857-2875) under a principal ignorability (PI) assumption. Using a Monte Carlo simulation study, we compared the performance of several strategies to build and use principal score models and the robustness of the method to violations of underlying assumptions, in particular PI. Results showed that the principal score approach yielded unbiased estimates of the causal marginal log odds ratio under PI but that the method was sensitive to violations of PI, which occurs in particular when confounders are omitted from the analysis. For principal score analysis, probability weighting performed slightly better than full matching or 1:1 matching. Concerning the variables to be included in principal score models, the lowest mean squared error was generally obtained when using the true confounders. Using variables associated with the outcome only but not compliance however yielded very similar performance.

[1]  Jasjeet S. Sekhon,et al.  Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching Package for R , 2008 .

[2]  Daniel Westreich,et al.  Propensity score estimation: neural networks, support vector machines, decision trees (CART), and meta-classifiers as alternatives to logistic regression. , 2010, Journal of clinical epidemiology.

[3]  B. Hansen.  Full Matching in an Observational Study of Coaching for the SAT , 2004 .

[4]  D. Rubin.  Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment , 1980 .

[5]  Elizabeth A Stuart,et al.  On the use of propensity scores in principal causal effect estimation , 2009, Statistics in medicine.

[6]  Thomas Lumley,et al.  Analysis of Complex Survey Samples , 2004 .

[7]  Dean A. Follmann,et al.  On the Effect of Treatment among Would-Be Treatment Compliers: An Analysis of the Multiple Risk Factor Intervention Trial , 2000 .

[8]  P. Rosenbaum.  A Characterization of Optimal Designs for Observational Studies , 1991 .

[9]  D. Rubin,et al.  Assessing the effect of an influenza vaccine in an encouragement design. , 2000, Biostatistics.

[10]  R. Porcher,et al.  Propensity score applied to survival data analysis through proportional hazards models: a Monte Carlo study , 2012, Pharmaceutical statistics.

[11]  Marshall Joffe,et al.  Causal logistic models for non‐compliance under randomized treatment with univariate binary response , 2003, Statistics in medicine.

[12]  Gary King,et al.  MatchIt: Nonparametric Preprocessing for Parametric Causal Inference , 2011 .

[13]  G. Imbens,et al.  Analyzing a randomized trial on breast self-examination with noncompliance and missing outcomes. , 2004, Biostatistics.

[14]  Jerome P. Reiter,et al.  A comparison of two methods of estimating propensity scores after multiple imputation , 2016, Statistical methods in medical research.

[15]  James Stafford,et al.  The Performance of Two Data-Generation Processes for Data with Specified Marginal Treatment Odds Ratios , 2008, Commun. Stat. Simul. Comput..

[16]  D. Rubin.  Statistics and Causal Inference: Comment: Which Ifs Have Causal Answers , 1986 .

[17]  Raphaël Porcher,et al.  Propensity scores in intensive care and anaesthesiology literature: a systematic review , 2010, Intensive Care Medicine.

[18]  Sylvie Chevret,et al.  Evaluation of the Propensity score methods for estimating marginal odds ratios in case of small sample size , 2012, BMC Medical Research Methodology.

[19]  P. Austin,et al.  Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies , 2010, Pharmaceutical statistics.

[20]  Peter C Austin,et al.  A comparison of 12 algorithms for matching on the propensity score , 2013, Statistics in medicine.

[21]  Jasjeet S. Sekhon,et al.  Genetic Optimization Using Derivatives , 2011, Political Analysis.

[22]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[23]  Marshall M Joffe,et al.  The compliance score as a regressor in randomized trials. , 2003, Biostatistics.

[24]  G Molenberghs,et al.  Estimating the causal effect of compliance on binary outcome in randomized controlled trials. , 1998, Statistics in medicine.

[25]  Dylan Small,et al.  Defining and Estimating Intervention Effects for Groups that will Develop an Auxiliary Outcome , 2007 .

[26]  J. Avorn,et al.  Variable selection for propensity score models. , 2006, American journal of epidemiology.

[27]  G. Imbens,et al.  Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score , 2000 .

[28]  Peter C Austin,et al.  A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study , 2007, Statistics in medicine.

[29]  A. Cohen-Solal,et al.  An education program for risk factor management after an acute coronary syndrome: a randomized clinical trial. , 2014, JAMA internal medicine.

[30]  Donald B Rubin,et al.  Principal Stratification for Causal Inference With Extended Partial Compliance , 2008 .

[31]  P. Rosenbaum.  Model-Based Direct Adjustment , 1987 .

[32]  J. Robins.  Correcting for non-compliance in randomized trials using structural nested mean models , 1994 .

[33]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[34]  N. Nagelkerke,et al.  Estimating treatment effects in randomized clinical trials in the presence of non-compliance. , 2000, Statistics in medicine.

[35]  D. Rubin,et al.  Principal Stratification in Causal Inference , 2002, Biometrics.

[36]  Elizabeth A Stuart,et al.  Improving propensity score weighting using machine learning , 2010, Statistics in medicine.

[37]  Søren Højsgaard,et al.  The R Package geepack for Generalized Estimating Equations , 2005 .

[38]  Peter C Austin,et al.  A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003 , 2008, Statistics in medicine.

[39]  J. Lunceford,et al.  Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study , 2004, Statistics in medicine.

[40]  Jennifer Hill,et al.  Reducing Bias in Treatment Effect Estimation in Observational Studies Suffering from Missing Data , 2004 .