Synthetic Control Methods: Never Use All Pre-Intervention Outcomes Together With Covariates

It is becoming increasingly popular in applications of synthetic control methods to include the entire pre-treatment path of the outcome variable as economic predictors. We demonstrate both theoretically and empirically that using all outcome lags as separate predictors renders all other covariates irrelevant. This finding holds irrespective of how important these covariates are for accurately predicting post-treatment values of the outcome, potentially threatening the estimator's unbiasedness. We show that estimation results and corresponding policy conclusions can change considerably when the usage of outcome lags as predictors is restricted, resulting in other covariates obtaining positive weights.

[1]  Laurent Gobillon,et al.  Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls , 2014, Review of Economics and Statistics.

[2]  Susan Athey,et al.  The State of Applied Econometrics - Causality and Policy Evaluation , 2016, 1607.00699.

[3]  Brian Galle,et al.  Financial incentives for kidney donation: A comparative case study using synthetic controls. , 2015, Journal of health economics.

[4]  Sebastian Bauhoff The effect of school district nutrition policies on dietary intake and overweight: a synthetic control approach. , 2014, Economics and human biology.

[5]  Matt Sutton,et al.  Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units , 2015, Health economics.

[6]  Henrik Kleven,et al.  Taxation and International Migration of Superstars: Evidence from the European Football Market , 2010 .

[7]  Tommaso Nannicini,et al.  Assessing Economic Liberalization Episodes: A Synthetic Control Approach , 2013, Review of Economics and Statistics.

[8]  Ilan Noy,et al.  Capital Controls in Brazil – Stemming a Tide with a Signal? , 2013 .

[9]  Steven Raphael,et al.  Did the 2007 Legal Arizona Workers Act Reduce the State's Unauthorized Immigrant Population? , 2014, Review of Economics and Statistics.

[10]  Jose G Montalvo,et al.  Voting after the Bombings: A Natural Experiment on the Effect of Terrorist Attacks on Democratic Elections , 2011, Review of Economics and Statistics.

[11]  Jasjeet S. Sekhon,et al.  Estimating causal effects: considering three alternatives to difference-in-differences estimation , 2016, Health Services and Outcomes Research Methodology.

[12]  Michèle Belot,et al.  Evaluating the ‘threat’ effects of grade repetition: exploiting the 2001 reform by the French-Speaking Community of Belgium , 2014 .

[13]  Jenna Stearns The effects of paid maternity leave: Evidence from Temporary Disability Insurance. , 2015, Journal of health economics.

[14]  R. Kaestner,et al.  Effects of ACA Medicaid Expansions on Health Insurance Coverage and Labor Supply , 2015, Journal of policy analysis and management : [the journal of the Association for Public Policy Analysis and Management].

[15]  Simon Johnson,et al.  The Value of Connections in Turbulent Times: Evidence from the United States , 2013 .

[16]  Alberto Abadie,et al.  The Economic Costs of Conflict: A Case Study of the , 2003 .

[17]  Jens Hainmueller,et al.  Comparative Politics and the Synthetic Control Method , 2014 .

[18]  Shimeng Liu,et al.  Spillovers from Universities: Evidence from the Land-Grant Program , 2015 .

[19]  A. Hosny,et al.  Algeria’s Trade with GAFTA Countries: A Synthetic Control Approach , 2012 .

[20]  Ilan Noy,et al.  Catastrophic Natural Disasters and Economic Growth , 2010, Review of Economics and Statistics.

[21]  Ozkan Eren,et al.  What Do Right-to-Work Laws Do? Evidence from a Synthetic Control Method Analysis , 2016 .

[22]  Ainhoa Vega-Bayo,et al.  An Empirical Comparison Between the Synthetic Control Method and HSIAO et al.'s Panel Data Approach to Program Evaluation , 2017 .

[23]  Tommaso Nannicini,et al.  Economies in Transition: How Important is Trade Openness for Growth? , 2011 .

[24]  Bruno Ferman,et al.  Cherry Picking with Synthetic Controls , 2020 .

[25]  Peter L. Hinrichs The Effects of Affirmative Action Bans on College Enrollment, Educational Attainment, and the Demographic Composition of Universities , 2012, Review of Economics and Statistics.

[26]  Bruno Ferman,et al.  Revisiting the synthetic control estimator , 2016 .

[27]  G. Imbens,et al.  Balancing, Regression, Difference-in-Differences and Synthetic Control Methods: A Synthesis , 2016, 1610.07748.

[28]  Ilan Noy,et al.  Hurricane Iniki: measuring the long-term economic impact of a natural disaster using synthetic control , 2011, Environment and Development Economics.

[29]  Jens Hainmueller,et al.  SYNTH: Stata module to implement Synthetic Control Methods for Comparative Case Studies , 2011 .