Toward a better understanding of when to apply propensity scoring: a comparison with conventional regression in ethnic disparities research.

PURPOSE Despite growing popularity of propensity score (PS) methods used in ethnic disparities studies, many researchers lack clear understanding of when to use PS in place of conventional regression models. One such scenario is presented here: When the relationship between ethnicity and primary care utilization is confounded with and modified by socioeconomic status. Here, standard regression fails to produce an overall disparity estimate, whereas PS methods can through the choice of a reference sample (RS) to which the effect estimate is generalized. METHODS Using data from the National Alcohol Surveys, ethnic disparities between White and Hispanics in access to primary care were estimated using PS methods (PS stratification and weighting), standard logistic regression, and the marginal effects from logistic regression models incorporating effect modification. RESULTS Whites, Hispanics, and combined White/Hispanic samples were used separately as the RS. Two strategies utilizing PS generated disparities estimates different from those from standard logistic regression, but similar to marginal odd ratios from logistic regression with ethnicity by covariate interactions included in the model. CONCLUSIONS When effect modification is present, PS estimates are comparable with marginal estimates from regression models incorporating effect modification. The estimation process requires a priori hypotheses to guide selection of the RS.

[1]  J. Rehm,et al.  Age-period-cohort modelling of alcohol volume and heavy drinking days in the US National Alcohol Surveys: divergence in younger and older adult trends. , 2009, Addiction.

[2]  R. Heidel,et al.  Healthy People 2000: national health promotion and disease prevention objectives (excerpts). US Public Health Service. , 1991, Journal of allied health.

[3]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[4]  J. Pearl,et al.  Confounding and Collapsibility in Causal Inference , 1999 .

[5]  L. Schmidt,et al.  Preventing disparities in alcohol screening and brief intervention: the need to move beyond primary care. , 2011, Alcoholism, clinical and experimental research.

[6]  R. Hood,et al.  Confronting racial and ethnic disparities in health care. , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[7]  T. Bauer,et al.  An extension of the Blinder–Oaxaca decomposition to nonlinear models , 2006 .

[8]  J. Robins,et al.  Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity-based weighting under conditions of nonuniform effect. , 2006, American journal of epidemiology.

[9]  D. Rubin,et al.  The bias due to incomplete matching. , 1983, Biometrics.

[10]  A. Blinder Wage Discrimination: Reduced Form and Structural Estimates , 1973 .

[11]  R. D'Agostino Adjustment Methods: Propensity Score Methods for Bias Reduction in the Comparison of a Treatment to a Non‐Randomized Control Group , 2005 .

[12]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[13]  N. Adler,et al.  Disparities in Health : Descriptions , Causes , and Mechanisms , 2008 .

[14]  D. Rubin,et al.  Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score , 1985 .

[15]  Mark Lunt,et al.  Different Methods of Balancing Covariates Leading to Different Effect Estimates in the Presence of Effect Modification , 2009, American journal of epidemiology.

[16]  Donald Rubin,et al.  Estimating Causal Effects from Large Data Sets Using Propensity Scores , 1997, Annals of Internal Medicine.

[17]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[18]  Rajeev Dehejia,et al.  Propensity Score-Matching Methods for Nonexperimental Causal Studies , 2002, Review of Economics and Statistics.

[19]  K. Rothman,et al.  Insights into different results from different causal contrasts in the presence of effect‐measure modification , 2006, Pharmacoepidemiology and drug safety.

[20]  Y. Matsuyama,et al.  Marginal Structural Models as a Tool for Standardization , 2003, Epidemiology.

[21]  David R. Williams,et al.  Us socioeconomic and racial differences in health: patterns and explanations , 1995 .

[22]  N. Adler,et al.  U.S. disparities in health: descriptions, causes, and mechanisms. , 2008, Annual review of public health.

[23]  F. Fantozzi,et al.  Helping patients who drinks too much. A Clinician’s Guide , 2006 .

[24]  Anthonius de Boer,et al.  Systematic differences in treatment effect estimates between propensity score methods and logistic regression. , 2008, International journal of epidemiology.

[25]  R. Oaxaca Male-Female Wage Differentials in Urban Labor Markets , 1973 .

[26]  Til Stürmer,et al.  A review of the application of propensity score methods yielded increasing use, advantages in specific settings, but not substantially different estimates compared with conventional multivariable methods. , 2006, Journal of clinical epidemiology.

[27]  Peter C Austin,et al.  Propensity score methods gave similar results to traditional regression modeling in observational studies: a systematic review. , 2005, Journal of clinical epidemiology.

[28]  J. Kaufman Marginalia: comparing adjusted effect measures. , 2010, Epidemiology.

[29]  Adrienne Y. Stith,et al.  Unequal treatment: confronting racial and ethnic disparities in health care. , 2003 .

[30]  R. Caetano,et al.  Ethnicity and Health Disparities in Alcohol Research , 2010, Alcohol research & health : the journal of the National Institute on Alcohol Abuse and Alcoholism.

[31]  Sander Greenland,et al.  Modern Epidemiology 3rd edition , 1986 .

[32]  L. Schmidt,et al.  Ethnic disparities in clinical severity and services for alcohol problems: results from the National Alcohol Survey. , 2007, Alcoholism, clinical and experimental research.

[33]  Martin Schumacher,et al.  Estimators and confidence intervals for the marginal odds ratio using logistic regression and propensity score stratification , 2010, Statistics in medicine.

[34]  D. Rubin ASSIGNMENT TO TREATMENT GROUP ON THE BASIS OF A COVARIATE , 1976 .

[35]  Marco Caliendo,et al.  Some Practical Guidance for the Implementation of Propensity Score Matching , 2005, SSRN Electronic Journal.

[36]  M. Gail,et al.  Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates , 1984 .