Synthetic Control Group Methods in the Presence of Interference: The Direct and Spillover Effects of Light Rail on Neighborhood Retail Activity

In recent years, Synthetic Control Group (SCG) methods have received great attention from scholars and have been subject to extensions and comparisons with alternative approaches for program evaluation. However, the existing methodological literature mainly relies on the assumption of non-interference. We propose to generalize the SCG method to studies where interference between the treated and the untreated units is plausible. We frame our discussion in the potential outcomes approach. Under a partial interference assumption, we formally define relevant direct and spillover effects. We also consider the "unrealized" spillover effect on the treated unit in the hypothetical scenario that another unit in the treated unit's neighborhood had been assigned to the intervention. Then we investigate the assumptions under which we can identify and estimate the causal effects of interest, and show how they can be estimated using the SCG method. We apply our approach to the analysis of an observational study, where the focus is on assessing direct and spillover causal effects of a new light rail line recently built in Florence (Italy) on the commercial vitality of the street where it was built and of the streets in the treated street's neighborhood.

[1]  Michihito Ando,et al.  Dreams of Urbanization: Quantitative Case Studies on the Local Impacts of Nuclear Power Facilities Using the Synthetic Control Method , 2014 .

[2]  Jose G Montalvo,et al.  Voting after the Bombings: A Natural Experiment on the Effect of Terrorist Attacks on Democratic Elections , 2011, Review of Economics and Statistics.

[3]  Michael E. Sobel,et al.  What Do Randomized Studies of Housing Mobility Demonstrate? , 2006 .

[4]  Alberto Abadie,et al.  The Economic Costs of Conflict: A Case Study of the , 2003 .

[5]  Martin Becker,et al.  Cross-Validating Synthetic Controls , 2017 .

[6]  Ilan Noy,et al.  Hurricane Iniki: measuring the long-term economic impact of a natural disaster using synthetic control , 2011, Environment and Development Economics.

[7]  Ozkan Eren,et al.  What Do Right-to-Work Laws Do? Evidence from a Synthetic Control Method Analysis , 2016 .

[8]  Corwin M Zigler,et al.  Causal inference with interfering units for cluster and population level treatment allocation programs , 2017, Biometrics.

[9]  I. Nilsson,et al.  New rail transit stations and the out-migration of low-income residents , 2020, Urban Studies.

[10]  W. Reilly The law of retail gravitation , 1931 .

[11]  D. Rubin,et al.  Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction , 2016 .

[12]  L. Casolaro,et al.  Please in My Back Yard: The Private and Public Benefits of a New Tram Line in Florence , 2018 .

[13]  Edoardo M. Airoldi,et al.  Identification and Estimation of Treatment and Interference Effects in Observational Studies on Networks , 2016, Journal of the American Statistical Association.

[14]  Enrica Papa,et al.  Urban rail systems investments: an analysis of the impacts on property values and residents’ location , 2011 .

[15]  D. Rubin Causal Inference Using Potential Outcomes , 2005 .

[16]  B. Berry,et al.  RECENT DEVELOPMENTS OF CENTRAL PLACE THEORY , 2005 .

[17]  Christopher E. Ferrell,et al.  TRANSIT-ORIENTED DEVELOPMENT IN THE UNITED STATES: EXPERIENCES, CHALLENGES, AND PROSPECTS , 2004 .

[18]  Tyler J VanderWeele,et al.  On causal inference in the presence of interference , 2012, Statistical methods in medical research.

[19]  Eleonora Patacchini,et al.  Treatment Effects With Heterogeneous Externalities , 2019, Journal of Business & Economic Statistics.

[20]  David R. Bowes,et al.  Identifying the Impacts of Rail Transit Stations on Residential Property Values , 2001 .

[21]  Jose Manuel Vassallo,et al.  Transportation Infrastructure Impacts on Firm Location: The Effect of a New Metro Line in the Suburbs of Madrid , 2012 .

[22]  Ainhoa Vega-Bayo,et al.  An Empirical Comparison Between the Synthetic Control Method and HSIAO et al.'s Panel Data Approach to Program Evaluation , 2017 .

[23]  Jens Hainmueller,et al.  Comparative Politics and the Synthetic Control Method , 2014 .

[24]  Sebastian Bauhoff The effect of school district nutrition policies on dietary intake and overweight: a synthetic control approach. , 2014, Economics and human biology.

[25]  Matt Sutton,et al.  Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units , 2015, Health economics.

[26]  J. Schuetz Do rail transit stations encourage neighbourhood retail activity? , 2015 .

[27]  L. Bertolini,et al.  Accessibility and Transit-Oriented Development in European metropolitan areas , 2015 .

[28]  Robert Cervero,et al.  The Half-Mile Circle: Does It Best Represent Transit Station Catchments? , 2012 .

[29]  Robert Cervero,et al.  Half-Mile Circle , 2012 .

[30]  D. Andrews,et al.  End-of-Sample Instability Tests , 2002 .

[31]  Stephen Brown Retail Location Theory: Evolution and Evaluation , 1993 .

[32]  B. Arpino,et al.  Assessing the causal effects of financial aids to firms in Tuscany allowing for interference , 2016 .

[33]  Oleg A. Smirnov,et al.  Measuring the effect of transportation infrastructure on retail firm co-location patterns , 2016 .

[34]  Whitney Newey,et al.  Treatment Effects , 2007 .

[35]  Marcos Sanso-Navarro,et al.  The Effects on American Foreign Direct Investment in the United Kingdom from not Adopting the Euro , 2011 .

[36]  E. Airoldi,et al.  Estimating Causal Effects Under Interference Using Bayesian Generalized Propensity Scores , 2018, 1807.11038.

[37]  N. Campos,et al.  Institutional integration and economic growth in Europe , 2019, Journal of Monetary Economics.

[38]  D. Basu Randomization Analysis of Experimental Data: The Fisher Randomization Test , 1980 .

[39]  G. Pellegrini,et al.  Industrial policy evaluation in the presence of spillovers , 2017 .

[40]  G. Imbens,et al.  Balancing, Regression, Difference-in-Differences and Synthetic Control Methods: A Synthesis , 2016, 1610.07748.

[41]  Kevin Credit,et al.  Transit-oriented economic development: The impact of light rail on new business starts in the Phoenix, AZ Region, USA , 2018 .

[42]  Paolo Pinotti,et al.  The Economic Costs of Organised Crime: Evidence from Southern Italy , 2015 .

[43]  D. Rubin Estimating causal effects of treatments in randomized and nonrandomized studies. , 1974 .

[44]  P. Aronow A General Method for Detecting Interference Between Units in Randomized Experiments , 2010 .

[45]  Matthew E. Kahn Gentrification Trends in New Transit-Oriented Communities: Evidence from 14 Cities that Expanded and Built Rail Transit Systems , 2007 .

[46]  M. Hudgens,et al.  Toward Causal Inference With Interference , 2008, Journal of the American Statistical Association.

[47]  K. Grier,et al.  The economic consequences of Hugo Chavez: A synthetic control analysis , 2016 .

[48]  Sergio Firpo,et al.  Synthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets , 2018, Journal of Causal Inference.

[49]  Jianfei Cao,et al.  Estimation and Inference for Synthetic Control Methods with Spillover Effects , 2019, 1902.07343.

[50]  Sauro Mocetti,et al.  Natural Disasters, Growth and Institutions: A Tale of Two Earthquakes , 2014 .

[51]  Henrik Kleven,et al.  Taxation and International Migration of Superstars: Evidence from the European Football Market , 2010 .

[52]  Susan Athey,et al.  The State of Applied Econometrics - Causality and Policy Evaluation , 2016, 1607.00699.

[53]  Steven Raphael,et al.  Did the 2007 Legal Arizona Workers Act Reduce the State's Unauthorized Immigrant Population? , 2014, Review of Economics and Statistics.

[54]  Shimeng Liu,et al.  Spillovers from Universities: Evidence from the Land-Grant Program , 2015 .

[55]  R. Cervero,et al.  Assessing the impacts of urban rail transit on local real estate markets using quasi-experimental comparisons , 1993 .

[56]  Elizabeth C. Delmelle,et al.  Transit investments and neighborhood change: On the likelihood of change , 2018 .

[57]  S. Greenland,et al.  Estimating causal effects. , 2002, International journal of epidemiology.

[58]  M. Fitzpatrick,et al.  Does State Preschool Crowd-Out Private Provision? The Impact of Universal Preschool on the Childcare Sector in Oklahoma and Georgia , 2012 .

[59]  Bruno Ferman,et al.  Revisiting the synthetic control estimator , 2016 .

[60]  Johan P. Larsson,et al.  Location and co-location in retail: a probabilistic approach using geo-coded data for metropolitan retail markets , 2014 .

[61]  Dan S. Rickman,et al.  Regional Economic Impacts of the Shale Gas and Tight Oil Boom: A Synthetic Control Analysis , 2014 .

[62]  Frederick Mosteller,et al.  Identification and estimation. , 1955 .

[63]  James Alm,et al.  Evaluating the Economic Effects of Flat Tax Reforms Using Synthetic Control Methods , 2016 .

[64]  Simon Johnson,et al.  The Value of Connections in Turbulent Times: Evidence from the United States , 2013 .

[65]  Guido Blasio,et al.  Boulevard of broken dreams. The end of EU funding (1997: Abruzzi, Italy) , 2016 .

[66]  P. Calthorpe The Next American Metropolis: Ecology, Community, and the American Dream , 1993 .

[67]  Laurent Gobillon,et al.  Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls , 2014, Review of Economics and Statistics.

[68]  Avi Feller,et al.  The Augmented Synthetic Control Method , 2018, Journal of the American Statistical Association.

[69]  Yiqing Xu Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models , 2016, Political Analysis.

[70]  Matthew E. Kahn,et al.  The effects of new public projects to expand urban rail transit , 2000 .

[71]  P. Rosenbaum Interference Between Units in Randomized Experiments , 2007 .

[72]  Ilan Noy,et al.  Catastrophic Natural Disasters and Economic Growth , 2010, Review of Economics and Statistics.

[73]  Andreas Steinmayr,et al.  A Framework for Separating Individual-Level Treatment Effects From Spillover Effects , 2019, Journal of Business & Economic Statistics.

[74]  Marco Di Cataldo,et al.  The Impact of EU Objective 1 Funds on Regional Development: Evidence from the U.K. And the Prospect of Brexit , 2017 .

[75]  Jake Bowers,et al.  Reasoning about Interference Between Units: A General Framework , 2013, Political Analysis.

[76]  Tommaso Nannicini,et al.  Assessing Economic Liberalization Episodes: A Synthetic Control Approach , 2013, Review of Economics and Statistics.

[77]  G. Imbens,et al.  Exact p-Values for Network Interference , 2015, 1506.02084.

[78]  Alberto Abadie,et al.  Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects , 2021, Journal of Economic Literature.

[79]  S. Raudenbush,et al.  Evaluating Kindergarten Retention Policy , 2006 .

[80]  G. Imbens,et al.  Matrix Completion Methods for Causal Panel Data Models , 2017, Journal of the American Statistical Association.

[81]  K. Lucas,et al.  Public transport investment and local regeneration: A comparison of London׳s Jubilee Line Extension and the Madrid Metrosur , 2014 .

[82]  Giovanni Mellace,et al.  The Inclusive Synthetic Control Method , 2020, SSRN Electronic Journal.

[83]  Torben K. Mideksa The economic impact of natural resources , 2013 .

[84]  Peter L. Hinrichs The Effects of Affirmative Action Bans on College Enrollment, Educational Attainment, and the Demographic Composition of Universities , 2012, Review of Economics and Statistics.

[85]  Stefan Klößner,et al.  Estimating the economic costs of organized crime by synthetic control methods , 2017 .

[86]  Z. Patterson,et al.  Urban rapid rail transit and gentrification in Canadian urban centres: A survival analysis approach , 2015 .

[87]  Peter M. Aronow,et al.  Estimating Average Causal Effects Under Interference Between Units , 2013, 1305.6156.