A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment

Difference-in-differences is a widely used evaluation strategy that draws causal inference from observational panel data. Its causal identification relies on the assumption of parallel trends, which is scale-dependent and may be questionable in some applications. A common alternative is a regression model that adjusts for the lagged dependent variable, which rests on the assumption of ignorability conditional on past outcomes. In the context of linear models, Angrist and Pischke (2009) show that the difference-in-differences and lagged-dependent-variable regression estimates have a bracketing relationship. Namely, for a true positive effect, if ignorability is correct, then mistakenly assuming parallel trends will overestimate the effect; in contrast, if the parallel trends assumption is correct, then mistakenly assuming ignorability will underestimate the effect. We show that the same bracketing relationship holds in general nonparametric (model-free) settings. We also extend the result to semiparametric estimation based on inverse probability weighting. We provide three examples to illustrate the theoretical results with replication files in Ding and Li (2019).

[1]  Christoph Hanck,et al.  Joshua D. Angrist and Jörn-Steffen Pischke (2009): Mostly Harmless Econometrics: An Empiricist’s Companion , 2011 .

[2]  Andrew M Ryan,et al.  Why We Should Not Be Indifferent to Specification Choices for Difference-in-Differences. , 2015, Health services research.

[3]  G. Breukelen ANCOVA Versus CHANGE From Baseline in Nonrandomized Studies: The Difference. , 2013 .

[4]  Jens Hainmueller,et al.  How Lasting is Voter Gratitude? An Analysis of the Short- and Long-Term Electoral Returns to Beneficial Policy , 2011 .

[5]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[6]  Jens Hainmueller,et al.  Comparative Politics and the Synthetic Control Method: COMPARATIVE POLITICS AND THE SYNTHETIC CONTROL METHOD , 2015 .

[7]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[8]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[9]  Dylan S. Small,et al.  Patterns of Effects and Sensitivity Analysis for Differences-in-Differences , 2019, 1901.01869.

[10]  Jasjeet S. Sekhon,et al.  Estimating causal effects: considering three alternatives to difference-in-differences estimation , 2016, Health Services and Outcomes Research Methodology.

[11]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[12]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[13]  Pedro H. C. Sant'Anna,et al.  Difference-in-Differences with Multiple Time Periods , 2018, Journal of Econometrics.

[14]  M. Lechner The Estimation of Causal Effects by Difference-in-Difference Methods , 2011 .

[15]  Edmund J. Malesky,et al.  The Impact of Recentralization on Public Services: A Difference-in-Differences Analysis of the Abolition of Elected Councils in Vietnam , 2014, American Political Science Review.

[16]  Ezra Hauer,et al.  Observational Before-After Studies in Road Safety , 1997 .

[17]  M. Nerlove,et al.  Biases in dynamic models with fixed effects , 1988 .

[18]  Stochastic Orders , 2008 .

[19]  David Card,et al.  Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania , 1993 .

[20]  Identification and Inference in Nonlinear Difference-in-Differences Models , 2006 .

[21]  Alberto Abadie Semiparametric Difference-in-Differences Estimators , 2005 .

[22]  O. Ashenfelter,et al.  Estimating the Effect of Training Programs on Earnings , 1976 .

[23]  L. Keele,et al.  How Much Is Minnesota Like Wisconsin? Assumptions and Counterfactuals in Causal Inference with Observational Data , 2013, Political Analysis.

[24]  Stephen Nickell,et al.  Biases in Dynamic Models with Fixed Effects , 1981 .

[25]  Judea Pearl,et al.  Causal Inference , 2010 .

[26]  E. Maris Covariance adjustment versus gain scores—revisited. , 1998 .

[27]  Alberto Abadie,et al.  The Economic Costs of Conflict: A Case Study of the , 2003 .

[28]  Tirthankar Dasgupta,et al.  Treatment Effects on Ordinal Outcomes: Causal Estimands and Sharp Bounds , 2015, 1507.01542.

[29]  P. Allison CHANGE SCORES AS DEPENDENT VARIABLES IN REGRESSION ANALYSIS , 1990 .

[30]  Ezra Hauer,et al.  OBSERVATIONAL BEFORE-AFTER STUDIES IN ROAD SAFETY -- ESTIMATING THE EFFECT OF HIGHWAY AND TRAFFIC ENGINEERING MEASURES ON ROAD SAFETY , 1997 .

[31]  Elizabeth A. Stuart,et al.  Using propensity scores in difference-in-differences models to estimate the effects of a policy change , 2014, Health Services and Outcomes Research Methodology.

[32]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .