Using the Propensity Score Method to Estimate Causal Effects

Evidence-based management requires management scholars to draw causal inferences. Researchers generally rely on observational data sets and regression models where the independent variables have not been exogenously manipulated to estimate causal effects; however, using such models on observational data sets can produce a biased effect size of treatment intervention. This article introduces the propensity score method (PSM)—which has previously been widely employed in social science disciplines such as public health and economics—to the management field. This research reviews the PSM literature, develops a procedure for applying the PSM to estimate the causal effects of intervention, elaborates on the procedure using an empirical example, and discusses the potential application of the PSM in different management fields. The implementation of the PSM in the management field will increase researchers’ ability to draw causal inferences using observational data sets.

[1]  G. Imbens The Role of the Propensity Score in Estimating Dose-Response Functions , 1999 .

[2]  Rajeev Dehejia,et al.  Propensity Score-Matching Methods for Nonexperimental Causal Studies , 2002, Review of Economics and Statistics.

[3]  T. DiPrete,et al.  7. Assessing Bias in the Estimation of Causal Effects: Rosenbaum Bounds on Matching Estimators and Instrumental Variables Estimation with Imperfect Instruments , 2004 .

[4]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[5]  Donald Rubin,et al.  Estimating Causal Effects from Large Data Sets Using Propensity Scores , 1997, Annals of Internal Medicine.

[6]  T. Shakespeare,et al.  Observational Studies , 2003 .

[7]  Jeffrey M. Woodbridge Econometric Analysis of Cross Section and Panel Data , 2002 .

[8]  P. Rosenbaum The Role of a Second Control Group in an Observational Study , 1987 .

[9]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[10]  J. Angrist,et al.  Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs : The Case of Manpower Training , 2007 .

[11]  A Quasi-Experimental Design for Studies on the Impact of Administrative Decisions: Applications and Extensions of the Regression-Discontinuity Design , 1998 .

[12]  D. Green,et al.  Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment , 2006, Political Analysis.

[13]  Paul R. Rosenbaum,et al.  Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms , 1993 .

[14]  Sascha O. Becker,et al.  Estimation of Average Treatment Effects Based on Propensity Scores , 2002 .

[15]  Paul R. Rosenbaum,et al.  Balanced Risk Set Matching , 2001 .

[16]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[17]  J. Friedman Greedy function approximation: A gradient boosting machine. , 2001 .

[18]  J. Heckman Sample selection bias as a specification error , 1979 .

[19]  Keying Ye,et al.  Applied Bayesian Modeling and Causal Inference From Incomplete-Data Perspectives , 2005, Technometrics.

[20]  Yu.V. Davydova,et al.  The real effects of financial constraints: Evidence from a debt subsidization program targeted at strategic firms , 2014 .

[21]  Robert O. Keohane,et al.  Designing Social Inquiry: Scientific Inference in Qualitative Research. , 1995 .

[22]  Ulrike Malmendier,et al.  Superstar CEOS , 2005 .

[23]  Greg Ridgeway,et al.  Toolkit for Weighting and Analysis of Nonequivalent Groups , 2014 .

[24]  Kenneth G. Brown,et al.  The Very Separate Worlds Of Academic And Practitioner Periodicals In Human Resource Management: Implications For Evidence-Based Management , 2007 .

[25]  Yuhai Xuan Empire-Building or Bridge-Building? Evidence from New CEOs' Internal Capital Allocation Decisions , 2009 .

[26]  E. Cantoni Analysis of Robust Quasi-deviances for Generalized Linear Models , 2004 .

[27]  J. Angrist,et al.  Estimating the Labor Market Impact of Voluntary Military Service Using Social Security Data on Military Applicants , 1995 .

[28]  Denise M. Rousseau,et al.  Is there Such a thing as “Evidence-Based Management”? , 2006 .

[29]  I. Akresh,et al.  Latino Immigrants and the U.S. Racial Order , 2010 .

[30]  B. Sianesi,et al.  PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing , 2003 .

[31]  W. G. Cochran The effectiveness of adjustment by subclassification in removing bias in observational studies. , 1968, Biometrics.

[32]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[33]  Peter M. Steiner,et al.  The importance of covariate selection in controlling for selection bias in observational studies. , 2010, Psychological methods.

[34]  C. Schriesheim Causal Analysis: Assumptions, Models, and Data , 1982 .

[35]  D. McCaffrey,et al.  Propensity score estimation with boosted regression for evaluating causal effects in observational studies. , 2004, Psychological methods.

[36]  James E. Helmreich,et al.  PSAgraphics: An R Package to Support Propensity Score Analysis , 2009 .

[37]  Kenneth A. Couch,et al.  Earnings Losses of Displaced Workers Revisited , 2010 .

[38]  P. Allison Fixed Effects Regression Models , 2009 .

[39]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[40]  R. Lalonde Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[41]  D. Rubin Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation , 2001, Health Services and Outcomes Research Methodology.

[42]  Christopher Winship,et al.  Counterfactuals and Causal Inference: Methods and Principles for Social Research , 2007 .

[43]  Elizabeth A Stuart,et al.  Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. , 2010, Psychological methods.

[44]  D. Cox Causality : some statistical aspects , 1992 .

[45]  Jasjeet S. Sekhon,et al.  Multivariate and Propensity Score Matching Software with Automated Balance Optimization: The Matching Package for R , 2008 .

[46]  Noam Wasserman,et al.  Founder-CEO Succession and the Paradox of Entrepreneurial Success , 2003, Organ. Sci..

[47]  D. Francis An introduction to structural equation models. , 1988, Journal of clinical and experimental neuropsychology.

[48]  P. Rosenbaum,et al.  Invited commentary: propensity scores. , 1999, American journal of epidemiology.

[49]  R. Berk An introduction to sample selection bias in sociological data. , 1983 .

[50]  Manju Puri,et al.  On the Benefits of Concurrent Lending and Underwriting , 2005 .

[51]  Robert E. Wood,et al.  Mediation Testing in Management Research , 2008 .

[52]  M. Gangl Scar Effects of Unemployment: An Assessment of Institutional Complementarities , 2006 .

[53]  D. Rubin Teaching Statistical Inference for Causal Effects in Experiments and Observational Studies , 2004 .

[54]  James J. Heckman,et al.  Econometric Evaluation of Social Programs, Part II: Using the Marginal Treatment Effect to Organize Alternative Econometric Estimators to Evaluate Social Programs, and to Forecast their Effects in New Environments , 2007 .

[55]  Bo Lu Latino Immigrants and the U.S. Racial Order: How and Where Do They Fit In? , 2008 .

[56]  Eric Grodsky Compensatory Sponsorship in Higher Education1 , 2007, American Journal of Sociology.

[57]  Murillo Campello,et al.  The Real Effects of Financial Constraints: Evidence from a Financial Crisis , 2009 .

[58]  J. A. Calvin Regression Models for Categorical and Limited Dependent Variables , 1998 .

[59]  Sascha O. Becker,et al.  Sensitivity Analysis for Average Treatment Effects , 2007 .

[60]  W. G. Cochran Analysis of covariance: Its nature and uses. , 1957 .

[61]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[62]  S. Morgan,et al.  Matching Estimators of Causal Effects , 2006 .

[63]  D. Rubin,et al.  Constructing a Control Group Using Multivariate Matched Sampling Methods That Incorporate the Propensity Score , 1985 .

[64]  J. Brüderl,et al.  Momentum or Deceleration? Theoretical and Methodological Reflections on the Analysis of Organizational Change , 2008 .

[65]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[66]  F. Wolfe,et al.  Heart failure in rheumatoid arthritis: rates, predictors, and the effect of anti-tumor necrosis factor therapy. , 2004, The American journal of medicine.

[67]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[68]  B. Hamilton,et al.  Correcting for Endogeneity in Strategic Management Research , 2003 .

[69]  Patrick M. Wright,et al.  MEASUREMENT ERROR IN RESEARCH ON THE HUMAN RESOURCES AND FIRM PERFORMANCE RELATIONSHIP: FURTHER EVIDENCE AND ANALYSIS , 2000 .

[70]  Philippe Jacquart,et al.  On making causal claims: A review and recommendations , 2010 .

[71]  Lawrence R. James,et al.  The unmeasured variables problem in path analysis. , 1980 .

[72]  P. Taylor,et al.  Anti–tumor necrosis factor therapies , 2001, Current opinion in rheumatology.

[73]  G. Hoetker The use of logit and probit models in strategic management research: Critical issues , 2007 .

[74]  Matthias Schonlau,et al.  Boosted Regression (Boosting): An Introductory Tutorial and a Stata Plugin , 2005 .

[75]  M. Lechner Program Heterogeneity and Propensity Score Matching: An Application to the Evaluation of Active Labor Market Policies , 2002, Review of Economics and Statistics.