The Role of Parallel Trends in Event Study Settings: An Application to Environmental Economics

Difference-in-Differences (DID) research designs usually rely on variation of treatment timing such that, after making an appropriate parallel trends assumption, one can identify, estimate, and make inference about causal effects. In practice, however, different DID procedures rely on different parallel trends assumptions (PTA), and recover different causal parameters. In this paper, we focus on staggered DID (also referred as event-studies) and discuss the role played by the PTA in terms of identification and estimation of causal parameters. We document a ``robustness'' vs. ``efficiency'' trade-off in terms of the strength of the underlying PTA, and argue that practitioners should be explicit about these trade-offs whenever using DID procedures. We propose new DID estimators that reflect these trade-offs and derived their large sample properties. We illustrate the practical relevance of these results by assessing whether the transition from federal to state management of the Clean Water Act affects compliance rates.

[1]  Andrew Goodman-Bacon Difference-in-Differences with Variation in Treatment Timing , 2018, Journal of Econometrics.

[2]  J. Roth Pre-test with Caution: Event-study Estimates After Testing for Parallel Trends , 2019 .

[3]  F. Windmeijer,et al.  Estimation of Panel Data Models with Binary Indicators When Treatment Effects are Not Constant Over Time , 2004 .

[4]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[5]  W. Newey,et al.  Average and Quantile Effects in Nonseparable Panel Models , 2009, 0904.1990.

[6]  J. Wooldridge Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models , 2005, Review of Economics and Statistics.

[7]  D. Rubin For objective causal inference, design trumps analysis , 2008, 0811.1640.

[8]  Michael Wolf,et al.  Centre De Referència En Economia Analítica Barcelona Economics Working Paper Series Working Paper Nº 17 Stewise Multiple Testing as Formalized Data Snooping Stepwise Multiple Testing as Formalized Data Snooping , 2022 .

[9]  Pedro H. C. Sant'Anna,et al.  Doubly robust difference-in-differences estimators , 2020 .

[10]  Bruno Ferman,et al.  Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity , 2019, Review of Economics and Statistics.

[11]  David A. Hirshberg,et al.  Synthetic Difference in Differences , 2018, 1812.09970.

[12]  Michael B. Urbancic,et al.  Broken or Fixed Effects? , 2014 .

[13]  Susan Athey,et al.  Design-Based Analysis in Difference-in-Differences Settings with Staggered Adoption , 2018, Journal of Econometrics.

[14]  Scott Cunningham Causal Inference , 2021 .

[15]  Liyang Sun,et al.  Estimating Dynamic Treatment Effects in Event Studies With Heterogeneous Treatment Effects , 2018, Journal of Econometrics.

[16]  Michael L. Anderson Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects , 2008 .

[17]  Jonathan Roth,et al.  An Honest Approach to Parallel Trends , 2019 .

[18]  K. Grooms Enforcing the Clean Water Act: The effect of state-level corruption on compliance , 2015 .

[19]  Pedro H. C. Sant'Anna,et al.  Doubly Robust Difference-in-Differences Estimators , 2018, Journal of Econometrics.

[20]  Azeem M. Shaikh,et al.  Hypothesis Testing in Econometrics , 2009 .

[21]  Xavier d'Haultfoeuille,et al.  Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects , 2018, American Economic Review.

[22]  L. Hansen Large Sample Properties of Generalized Method of Moments Estimators , 1982 .

[23]  Identification in nonparametric models for dynamic treatment effects , 2020 .

[24]  Joshua D. Angrist,et al.  Mostly Harmless Econometrics: An Empiricist's Companion , 2008 .

[25]  Pedro H. C. Sant'Anna,et al.  Difference-in-Differences with Multiple Time Periods , 2018, Journal of Econometrics.

[26]  M. Lechner The Estimation of Causal Effects by Difference-in-Difference Methods , 2011 .

[27]  D. Rubin The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials , 2007, Statistics in medicine.