Comparing Inverse Probability of Treatment Weighting and Instrumental Variable Methods for the Evaluation of Adenosine Diphosphate Receptor Inhibitors After Percutaneous Coronary Intervention.

IMPORTANCE There is increasing interest in performing comparative effectiveness analyses in large observational databases, yet these analyses must adjust for treatment selection issues. OBJECTIVES To conduct comparative safety and efficacy analyses of prasugrel vs clopidogrel bisulfate after percutaneous coronary intervention and to evaluate inverse probability of treatment weighting (a propensity score method) and instrumental variable methods. DESIGN, SETTING, AND PARTICIPANTS This study used data from the Treatment With Adenosine Diphosphate Receptor Inhibitors-Longitudinal Assessment of Treatment Patterns and Events After Acute Coronary Syndrome (TRANSLATE-ACS) study. Included in the study were patients undergoing percutaneous coronary intervention for myocardial infarction, 26.0% of whom received prasugrel. The study dates were April 4, 2010, to October 31, 2012. EXPOSURES Choice of initial antiplatelet agent (prasugrel or clopidogrel). MAIN OUTCOMES AND MEASURES Safety and efficacy outcomes included 1-year composite major adverse cardiovascular events, moderate to severe bleeding, and stent thrombosis. Hospitalizations for pneumonia, bone fractures, and planned percutaneous coronary intervention were used as the falsification end points. RESULTS The study cohort comprised 11 784 participants (mean [SD] age, 60.0 [11.6] years, and 28.0% were female). Using inverse probability of treatment weighting adjustment, prasugrel and clopidogrel had similar major adverse cardiovascular events (hazard ratio [HR], 0.98; 95% CI, 0.83-1.16) and bleeding outcomes (1.18; 0.77-1.80), but prasugrel had a lower rate of stent thrombosis (0.51; 0.31-0.85). Using instrumental variable methods, prasugrel use was associated with a lower rate of the major adverse cardiovascular event end point (HR, 0.68; 95% CI, 0.47-1.00) but nonsignificant differences in the rates of bleeding (0.95; 0.41-2.08) and stent thrombosis (0.67; 0.16-2.00). There was no significant treatment difference noted in any of the falsification end-point rates when analyses were performed using inverse probability of treatment weighting, although the bone fracture end point approached statistical significance. Nevertheless, a lower rate of pneumonia-related hospitalizations was noted in the prasugrel-treated patients when analyses were performed using instrumental variable methods. CONCLUSIONS AND RELEVANCE Conclusions regarding the safety and efficacy of antiplatelet therapy varied depending on analytic technique, and none were concordant with the results from randomized trials. In addition, both statistical strategies demonstrated concerning associations when tested in the falsification analyses. A high level of scrutiny and careful attention to assumptions and validity are required when interpreting complex analyses of observational data.

[1]  Alan M. Zaslavsky,et al.  Potential Bias of Instrumental Variable Analyses for Observational Comparative Effectiveness Research , 2014, Annals of Internal Medicine.

[2]  Peter C Austin,et al.  A comparison of 12 algorithms for matching on the propensity score , 2013, Statistics in medicine.

[3]  R. Groenwold Falsification end points for observational studies. , 2013, JAMA.

[4]  V. Prasad,et al.  Prespecified falsification end points: can they validate true observational associations? , 2013, JAMA.

[5]  T. Carey,et al.  Evaluating the effectiveness of a rapidly adopted cardiovascular technology with administrative data: the case of drug-eluting stents for acute coronary syndromes. , 2012, American heart journal.

[6]  K. Anstrom,et al.  Treatment with adenosine diphosphate receptor inhibitors-longitudinal assessment of treatment patterns and events after acute coronary syndrome (TRANSLATE-ACS) study design: expanding the paradigm of longitudinal observational research. , 2011, American heart journal.

[7]  P. Chan,et al.  Survival Benefit With Drug-Eluting Stents in Observational Studies: Fact or Artifact? , 2011, Circulation. Cardiovascular quality and outcomes.

[8]  M. Shah,et al.  Association between stroke center hospitalization for acute ischemic stroke and mortality. , 2011, JAMA.

[9]  Michael L. Johnson,et al.  Good research practices for comparative effectiveness research: analytic methods to improve causal inference from nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report--Part III. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[10]  Joseph P. Drozda,et al.  ACC 2009 Advocacy Position Statement: Principles for comparative effectiveness research. , 2009, Journal of the American College of Cardiology.

[11]  P. Austin Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples , 2009, Statistics in medicine.

[12]  M. Lauer Comparative effectiveness research: the view from the NHLBI. , 2009, Journal of the American College of Cardiology.

[13]  T. Blakely,et al.  Glossary for econometrics and epidemiology , 2008, Journal of Epidemiology & Community Health.

[14]  Paul J Rathouz,et al.  Two-stage residual inclusion estimation: addressing endogeneity in health econometric modeling. , 2008, Journal of health economics.

[15]  E. Antman,et al.  Prasugrel versus clopidogrel in patients with acute coronary syndromes. , 2007, The New England journal of medicine.

[16]  P. Serruys,et al.  Clinical End Points in Coronary Stent Trials: A Case for Standardized Definitions , 2007, Circulation.

[17]  Elliott S Fisher,et al.  Analysis of observational studies in the presence of treatment selection bias: effects of invasive cardiac management on AMI survival using propensity score and instrumental variable methods. , 2007, JAMA.

[18]  M Alan Brookhart,et al.  Evaluating Short-Term Drug Effects Using a Physician-Specific Prescribing Preference as an Instrumental Variable , 2006, Epidemiology.

[19]  S. Cole,et al.  Effect of highly active antiretroviral therapy on multiple AIDS-defining illnesses among male HIV seroconverters. , 2006, American journal of epidemiology.

[20]  J. Haukoos,et al.  Advanced statistics: bootstrapping confidence intervals for statistics with "difficult" distributions. , 2005, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[21]  Therese A. Stukel,et al.  Long-term Outcomes of Regional Variations in Intensity of Invasive vs Medical Management of Medicare Patients With Acute Myocardial Infarction , 2005 .

[22]  G. Imbens,et al.  Estimation of Causal Effects using Propensity Score Weighting: An Application to Data on Right Heart Catheterization , 2001, Health Services and Outcomes Research Methodology.

[23]  S. Johnston,et al.  Combining ecological and individual variables to reduce confounding by indication: case study--subarachnoid hemorrhage treatment. , 2000, Journal of clinical epidemiology.

[24]  B J McNeil,et al.  Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? Analysis using instrumental variables. , 1994, JAMA.

[25]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[26]  D. Rubin,et al.  Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score , 1985 .

[27]  Frans Van de Werf,et al.  An international randomized trial comparing four thrombolytic strategies for acute myocardial infarction. , 1993, The New England journal of medicine.