Evaluating the impact of unmeasured confounding with internal validation data: an example cost evaluation in type 2 diabetes.

The quantitative assessment of the potential influence of unmeasured confounders in the analysis of observational data is rare, despite reliance on the "no unmeasured confounders" assumption. In a recent comparison of costs of care between two treatments for type 2 diabetes using a health care claims database, propensity score matching was implemented to adjust for selection bias though it was noted that information on baseline glycemic control was not available for the propensity model. Using data from a linked laboratory file, data on this potential "unmeasured confounder" were obtained for a small subset of the original sample. By using this information, we demonstrate how Bayesian modeling, propensity score calibration, and multiple imputation can utilize this additional information to perform sensitivity analyses to quantitatively assess the potential impact of unmeasured confounding. Bayesian regression models were developed to utilize the internal validation data as informative prior distributions for all parameters, retaining information on the correlation between the confounder and other covariates. While assumptions supporting the use of propensity score calibration were not met in this sample, the use of Bayesian modeling and multiple imputation provided consistent results, suggesting that the lack of data on the unmeasured confounder did not have a strong impact on the original analysis, due to the lack of strong correlation between the confounder and the cost outcome variable. Bayesian modeling with informative priors and multiple imputation may be useful tools for unmeasured confounding sensitivity analysis in these situations. Further research to understand the operating characteristics of these methods in a variety of situations, however, remains.

[1]  R. Heine,et al.  Exenatide versus Insulin Glargine in Patients with Suboptimally Controlled Type 2 Diabetes , 2005, Annals of Internal Medicine.

[2]  Ralph B D'Agostino,et al.  Estimating treatment effects using observational data. , 2007, JAMA.

[3]  Jan P Vandenbroucke,et al.  Observational Research, Randomised Trials, and Two Views of Medical Science , 2008, PLoS medicine.

[4]  S. Schneeweiss,et al.  Assessing Residual Confounding of the Association between Antipsychotic Medications and Risk of Death using Survey Data , 2009, CNS drugs.

[5]  R. D'Agostino Adjustment Methods: Propensity Score Methods for Bias Reduction in the Comparison of a Treatment to a Non‐Randomized Control Group , 2005 .

[6]  R. D'Agostino Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. , 2005, Statistics in medicine.

[7]  Paul Gustafson,et al.  Probabilistic Approaches to Better Quantifying the Results of Epidemiologic Studies , 2010, International journal of environmental research and public health.

[8]  R. Ness,et al.  Periconceptional multivitamin use reduces the risk of preeclampsia. , 2006, American journal of epidemiology.

[9]  Douglas E. Faries,et al.  Analysis of Observational Health Care Data Using SAS , 2010 .

[10]  J. Robins,et al.  Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. , 2000, Epidemiology.

[11]  Lawrence C McCandless,et al.  A sensitivity analysis using information about measured confounders yielded improved uncertainty assessments for unmeasured confounding. , 2008, Journal of clinical epidemiology.

[12]  A. Hartz,et al.  A comparison of observational studies and randomized, controlled trials. , 2000, The New England journal of medicine.

[13]  Lizheng Shi,et al.  Healthcare resource utilization and costs assessment of type 2 diabetes patients initiating exenatide BID or glargine: a retrospective database analysis , 2011, Journal of medical economics.

[14]  Peter Davey,et al.  A checklist for retrospective database studies--report of the ISPOR Task Force on Retrospective Databases. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[15]  S. Schneeweiss Sensitivity analysis and external adjustment for unmeasured confounders in epidemiologic database studies of therapeutics , 2006, Pharmacoepidemiology and drug safety.

[16]  P. Gustafson,et al.  Bayesian sensitivity analysis for unmeasured confounding in observational studies , 2007, Statistics in medicine.

[17]  G. Oster,et al.  Lifetime health and economic benefits of weight loss among obese persons. , 1999, American journal of public health.

[18]  David E. Booth,et al.  Analysis of Incomplete Multivariate Data , 2000, Technometrics.

[19]  J. Trogdon,et al.  Nationally Representative Medical Costs of Diabetes by Time Since Diagnosis , 2008, Diabetes Care.

[20]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[21]  Til Stürmer,et al.  Adjusting effect estimates for unmeasured confounding with validation data using propensity score calibration. , 2005, American journal of epidemiology.

[22]  B. Hoogwerf,et al.  Effects of Exenatide on Diabetes, Obesity, Cardiovascular Risk Factors, and Hepatic Biomarkers in Patients with Type 2 Diabetes , 2008, Journal of diabetes science and technology.

[23]  Jalpa A Doshi,et al.  Analyses of cost data in economic evaluations conducted alongside randomized controlled trials. , 2006, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[24]  Anirban Basu,et al.  Generalized Modeling Approaches to Risk Adjustment of Skewed Outcomes Data , 2003, Journal of health economics.

[25]  H. Birnbaum,et al.  Short-term economic impact of body weight change among patients with type 2 diabetes treated with antidiabetic agents: analysis using claims, laboratory, and medical record data , 2007, Current medical research and opinion.

[26]  Til Stürmer,et al.  Performance of propensity score calibration--a simulation study. , 2007, American journal of epidemiology.

[27]  Comparison of several imputation methods for missing baseline data in propensity scores analysis of binary outcome. , 2010, Pharmaceutical statistics.

[28]  J. Concato,et al.  Randomized, controlled trials, observational studies, and the hierarchy of research designs. , 2000, The New England journal of medicine.

[29]  R. Willke,et al.  Good research practices for cost-effectiveness analysis alongside clinical trials: the ISPOR RCT-CEA Task Force report. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[30]  J. Walkup,et al.  Studying Prescription Drug Use and Outcomes With Medicaid Claims Data: Strengths, Limitations, and Strategies , 2007, Medical care.

[31]  S. Schneeweiss,et al.  Claims Data Studies of Sedative‐Hypnotics and Hip Fractures in Older People: Exploring Residual Confounding Using Survey Information , 2005, Journal of the American Geriatrics Society.