Inference for Factor Model Based Average Treatment Effects

In this paper we consider using a factor-model-based method, also known as the generalized synthetic control method, to estimate average treatment effects. This method is best suited for cases where there is only one (or a few) treated unit(s), a large number of control units, and large pre and post-treatment sample sizes (i.e., long panel). These settings of a long panel data are quite common in marketing due to the prevalence of daily and weekly data at the customer, store or company level. Existing inference methods lack theory and use a bootstrap or permutation procedure that either assumes that idiosyncratic errors have the same variance for the treated and control units or require that the treated units's error variances be the same during the pre and posttreatment periods. Our inference for the factor model based ATE addresses both issues, allowing the method to be more widely applied, and provides previously unknown distribution theory. We also propose a modified Bai and Ng model selection criterion to accurately select the number of factors even in finite samples. Simulations confirm our theoretical analysis, and an empirical application examines the effect of opening a showroom by e-tailer on its online sales.

[1]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[2]  Victor Chernozhukov,et al.  An Exact and Robust Conformal Inference Method for Counterfactual and Synthetic Controls , 2017, Journal of the American Statistical Association.

[3]  Sergio Firpo,et al.  Synthetic Control Method: Inference, Sensitivity Analysis and Confidence Sets , 2018, Journal of Causal Inference.

[4]  Ying Liu,et al.  The Value of Multi-Dimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments , 2017, Manag. Sci..

[5]  Ruoyao Shi,et al.  Synthetic Control and Inference , 2017 .

[6]  Avi Goldfarb,et al.  Can Offline Stores Drive Online Sales? , 2017 .

[7]  Gerard J. Tellis,et al.  Does Offline TV Advertising Affect Online Chatter? Quasi-Experimental Analysis Using Synthetic Control , 2016, Mark. Sci..

[8]  Kathleen T. Li,et al.  Estimation of average treatment effects with panel data: Asymptotic theory and implementation , 2017 .

[9]  Yiqing Xu Generalized Synthetic Control Method: Causal Inference with Interactive Fixed Effects Models , 2016, Political Analysis.

[10]  Bruno Ferman,et al.  Revisiting the synthetic control estimator , 2016 .

[11]  G. Imbens,et al.  Balancing, Regression, Difference-in-Differences and Synthetic Control Methods: A Synthesis , 2016, 1610.07748.

[12]  Marc K. Chan,et al.  Policy Evaluation with Interactive Fixed Effects , 2016 .

[13]  Laurent Gobillon,et al.  Regional Policy Evaluation: Interactive Fixed Effects and Synthetic Controls , 2014, Review of Economics and Statistics.

[14]  Zaichao Du,et al.  Home-purchase restriction, property tax and housing price in China: A counterfactual analysis , 2015 .

[15]  Kenneth C. Wilbur,et al.  Television Advertising and Online Shopping , 2014, Mark. Sci..

[16]  Cheng Hsiao,et al.  A Panel Data Approach for Program Evaluation — Measuring the Benefits of Political and Economic Integration of Hong Kong with Mainland China , 2012 .

[17]  Avi Goldfarb,et al.  Competition between Local and Electronic Markets: How the Benefit of Buying Online Depends on Where You Live , 2007, Manag. Sci..

[18]  Jushan Bai,et al.  Estimating cross-section common stochastic trends in nonstationary panel data , 2004 .

[19]  J. Bai,et al.  Inferential Theory for Factor Models of Large Dimensions , 2003 .

[20]  Alberto Abadie,et al.  The Economic Costs of Conflict: A Case Study of the , 2003 .

[21]  J. Bai,et al.  Determining the Number of Factors in Approximate Factor Models , 2000 .

[22]  Mark W. Watson,et al.  A SIMPLE ESTIMATOR OF COINTEGRATING VECTORS IN HIGHER ORDER INTEGRATED SYSTEMS , 1993 .

[23]  J. Shao Linear Model Selection by Cross-validation , 1993 .

[24]  D. Andrews Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation , 1991 .

[25]  Pentti Saikkonen,et al.  Asymptotically Efficient Estimation of Cointegration Regressions , 1991, Econometric Theory.

[26]  Orley Ashenfelter,et al.  Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs , 1984 .

[27]  O. Ashenfelter,et al.  Estimating the Effect of Training Programs on Earnings , 1976 .