The International Journal of Biostatistics Preference-Based Instrumental Variable Methods for the Estimation of Treatment Effects : Assessing Validity and Interpreting Results

Observational studies of prescription medications and other medical interventions based on administrative data are increasingly used to inform regulatory and clinical decision making. The validity of such studies is often questioned, however, because the available data may not contain measurements of important prognostic variables that guide treatment decisions. Recently, approaches to this problem have been proposed that use instrumental variables (IV) defined at the level of an individual health care provider or aggregation of providers. Implicitly, these approaches attempt to estimate causal effects by using differences in medical practice patterns as a quasi-experiment. Although preference-based IV methods may usefully complement standard statistical approaches, they make assumptions that are unfamiliar to most biomedical researchers and therefore the validity of such an analysis can be hard to evaluate. Here, we describe a simple framework based on a single unobserved dichotomous variable that can be used to explore how violations of IV assumptions and treatment effect heterogeneity may bias the standard IV estimator with respect to the average treatment effect in the population. This framework suggests various ways to anticipate the likely direction of bias using both empirical data and commonly available subject matter knowledge, such as whether medications or medical procedures tend to be overused, underused, or often misused. This approach is described in the context of a study comparing the gastrointestinal bleeding risk attributable to different non-steroidal anti-inflammatory drugs.

[1]  J. Avorn,et al.  Risk of death in elderly users of conventional vs. atypical antipsychotic medications. , 2005, The New England journal of medicine.

[2]  S Shapiro,et al.  Confounding by indication? , 1997, Epidemiology.

[3]  James J Heckman,et al.  Understanding Instrumental Variables in Models with Essential Heterogeneity , 2006, The Review of Economics and Statistics.

[4]  Sebastian Schneeweiss,et al.  A Medicare database review found that physician preferences increasingly outweighed patient characteristics as determinants of first-time prescriptions for COX-2 inhibitors. , 2005, Journal of clinical epidemiology.

[5]  R. Leone,et al.  Upper Gastrointestinal Bleeding Associated with the Use of NSAIDs Newer Versus Older Agents , 2004 .

[6]  J. Avorn,et al.  Determinants of selective cyclooxygenase-2 inhibitor prescribing: are patient or physician characteristics more important? , 2003, The American journal of medicine.

[7]  Wiebe R. Pestman,et al.  Instrumental Variables: Application and Limitations , 2006, Epidemiology.

[8]  Elliott S Fisher,et al.  Analysis of observational studies in the presence of treatment selection bias: effects of invasive cardiac management on AMI survival using propensity score and instrumental variable methods. , 2007, JAMA.

[9]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1994 .

[10]  John M Brooks,et al.  Was breast conserving surgery underutilized for early stage breast cancer? Instrumental variables evidence for stage II patients from Iowa. , 2003, Health services research.

[11]  J. Avorn,et al.  The Medical License Number Accurately Identifies the Prescribing Physician in a Large Pharmacy Claims Database , 2007, Medical care.

[12]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[13]  J. Avorn,et al.  Underuse of osteoporosis medications in elderly patients with fractures. , 2003, The American journal of medicine.

[14]  D. Rubin Comment: Which Ifs Have Causal Answers , 1986 .

[15]  Dylan S. Small,et al.  War and Wages : The Strength of Instrumental Variables and Their Sensitivity to Unobserved Biases , 2007 .

[16]  J. Robins,et al.  Instruments for Causal Inference: An Epidemiologist's Dream? , 2006, Epidemiology.

[17]  K. Harris,et al.  Who is the marginal patient? Understanding instrumental variables estimates of treatment effects. , 1998, Health services research.

[18]  P. Rosenbaum Identification of Causal Effects Using Instrumental Variables: Comment , 2007 .

[19]  Dylan S. Small,et al.  War and Wages , 2008 .

[20]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[21]  J. Gurwitz,et al.  Undertreatment of hyperlipidemia in the secondary prevention of coronary artery disease , 1999, Journal of General Internal Medicine.

[22]  M Alan Brookhart,et al.  Evaluating Short-Term Drug Effects Using a Physician-Specific Prescribing Preference as an Instrumental Variable , 2006, Epidemiology.

[23]  J. Wooldridge On two stage least squares estimation of the average treatment effect in a random coefficient model , 1997 .

[24]  E. Korn,et al.  Clinician Preferences and the Estimation of Causal Treatment Differences , 1998 .

[25]  David A. Jaeger,et al.  Problems with Instrumental Variables Estimation when the Correlation between the Instruments and the Endogenous Explanatory Variable is Weak , 1995 .

[26]  Uses of ecologic studies in the assessment of intended treatment effects. , 1999, Journal of clinical epidemiology.

[27]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1995 .

[28]  D. Rubin Statistics and Causal Inference: Comment: Which Ifs Have Causal Answers , 1986 .

[29]  W. Ray Observational studies of drugs and mortality. , 2005, The New England journal of medicine.

[30]  S. Johnston,et al.  Combining ecological and individual variables to reduce confounding by indication: case study--subarachnoid hemorrhage treatment. , 2000, Journal of clinical epidemiology.