Design-based analysis in Difference-In-Differences settings with staggered adoption

Abstract In this paper we study estimation of and inference for average treatment effects in a setting with panel data. We focus on the staggered adoption setting where units, e.g, individuals, firms, or states, adopt the policy or treatment of interest at a particular point in time, and then remain exposed to this treatment at all times afterwards. We take a design perspective where we investigate the properties of estimators and procedures given assumptions on the assignment process. We show that under random assignment of the adoption date the standard Difference-In-Differences (DID) estimator is an unbiased estimator of a particular weighted average causal effect. We characterize the exact finite sample properties of this estimand, and show that the standard variance estimator is conservative.

[1]  D. Rubin.  Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[2]  Donald K. K. Lee,et al.  SHARP BOUNDS ON THE VARIANCE IN RANDOMIZED EXPERIMENTS , 2014, 1405.6555.

[3]  Does Air Quality Matter? Evidence from the Housing Market , 2005, Journal of Political Economy.

[4]  G. Imbens.  The Role of the Propensity Score in Estimating Dose-Response Functions , 1999 .

[5]  Cyrus Samii,et al.  Does Regression Produce Representative Estimates of Causal Effects? , 2015 .

[6]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[7]  Kosuke Imai,et al.  When Should We Use Unit Fixed Effects Regression Models for Causal Inference with Longitudinal Data? , 2019, American Journal of Political Science.

[8]  Susan Athey,et al.  Sampling‐Based versus Design‐Based Uncertainty in Regression Analysis , 2017, Econometrica.

[9]  J. Stock,et al.  Heteroskedasticity-Robust Standard Errors for Fixed Effects Panel Data Regression , 2006 .

[10]  T. Speed,et al.  On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9 , 1990 .

[11]  Pre-Event Trends in the Panel Event-Study Design , 2019, American Economic Review.

[12]  R. Folsom,et al.  Inference about regression models from sample survey data , 1976 .

[13]  J. Heckman,et al.  Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation , 2007 .

[14]  Donald B. Rubin,et al.  Bayesian Inference for Causal Effects: The Role of Randomization , 1978 .

[15]  David Card,et al.  Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania , 1993 .

[16]  Jeffrey M. Wooldridge,et al.  Solutions Manual and Supplementary Materials for Econometric Analysis of Cross Section and Panel Data , 2003 .

[17]  Stephen G. Donald,et al.  Inference with Difference-in-Differences and Other Panel Data , 2007, The Review of Economics and Statistics.

[18]  Timothy G. Conley,et al.  Inference with “Difference in Differences” with a Small Number of Policy Changes , 2005, The Review of Economics and Statistics.

[19]  Markku Rahiala,et al.  Panel Data , 2011, International Encyclopedia of Statistical Science.

[20]  David Card.  The Impact of the Mariel Boatlift on the Miami Labor Market , 1989 .

[21]  Alberto Abadie.  Semiparametric Difference-in-Differences Estimators , 2005 .

[22]  Gerard J. van den Berg,et al.  The nonparametric identification of treatment effects in duration models , 2003 .

[23]  M. Arellano,et al.  Computing Robust Standard Errors for Within-Groups Estimators , 2009 .

[24]  Identification in nonparametric models for dynamic treatment effects , 2020 .

[25]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[26]  Difference-in-Differences with multiple time periods , 2020 .

[27]  Xavier d'Haultfoeuille,et al.  Fuzzy Differences-in-Differences , 2015, 1510.01757.

[28]  J. Angrist,et al.  Empirical Strategies in Labor Economics , 1998 .

[29]  Estimating dynamic treatment effects in event studies with heterogeneous treatment effects , 2020 .

[30]  Exogeneity , 2019, Dynamic Econometrics for Empirical Macroeconomic Modelling.