Exogeneity and Robustness

A common practice for detecting misspecication is to perform a \robustness test", where the researcher examines how a regression coecient of interest behaves when variables are added to the regression. Robustness of the regression coecient is taken as evidence of structural validity. However, there are numerous pitfalls that can befall a researcher when performing such tests. For example, we demonstrate that certain regressors, when added to the regression, will induce a shift in the coecient of interest even when structurally valid. Such robustness tests would produce false alarm, suggesting that the model is misspecied when it is not. For a robustness test to be informative, the variables added to the regression must be carefully chosen based on the model structure. We provide a simple criterion that allows researchers to quickly determine which variables, when added to the regression, constitute informative robustness tests. We also explore the extent to which robustness tests are able to detect bias, demonstrating that robustness tests enable detection of bias due not only to omitted observable variables but omitted unobservable variables as well. Finally, we give two extended examples using simulated data to demonstrate how the material in this paper can be used to conduct informative robustness tests.

[1]  J. Wooldridge Should Instrumental Variables be Used as Matching Variables , 2016 .

[2]  Jin Tian,et al.  Testable Implications of Linear Structural Equation Models , 2014, AAAI.

[3]  Judea Pearl,et al.  Graphical Tools for Linear Structural Equation Modeling , 2014 .

[4]  Pearl Judea,et al.  Confounding Equivalence in Causal Inference , 2014 .

[5]  H. White,et al.  Robustness checks and robustness tests in applied economics , 2014 .

[6]  K. Hoover,et al.  Selecting Instrumental Variables: A Graph-Theoretic Approach , 2013 .

[7]  E. Oster,et al.  Unobservable Selection and Coefficient Stability: Theory and Validation , 2013 .

[8]  Halbert White,et al.  Causal Diagrams for Treatment Effect Estimation with Application to Efficient Covariate Selection , 2011, Review of Economics and Statistics.

[9]  H. White,et al.  Testing a conditional form of exogeneity , 2010 .

[10]  Judea Pearl,et al.  On a Class of Bias-Amplifying Variables that Endanger Effect Estimates , 2010, UAI.

[11]  H. Tiemeier,et al.  Variable selection: current practice in epidemiological studies , 2009, European Journal of Epidemiology.

[12]  Jin Tian,et al.  Markov Properties for Linear Causal Models with Correlated Errors , 2009, J. Mach. Learn. Res..

[13]  Halbert White,et al.  Settable Systems: An Extension of Pearl's Causal Model with Optimization, Equilibrium, and Learning , 2009, J. Mach. Learn. Res..

[14]  Jay Bhattacharya,et al.  Do Instrumental Variables Belong in Propensity Scores? , 2007 .

[15]  Judea Pearl,et al.  Robustness of Causal Claims , 2004, UAI.

[16]  K. Hoover Lost Causes , 2004, Journal of the History of Economic Thought.

[17]  Jinyong Hahn,et al.  Functional Restriction and Efficiency in Causal Inference , 2004, Review of Economics and Statistics.

[18]  Manabu Kuroki,et al.  Covariate selection for estimating the causal effect of control plans by using causal diagrams , 2003 .

[19]  Judea Pearl,et al.  Generalized Instrumental Variables , 2002, UAI.

[20]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[21]  Peter Spirtes,et al.  Directed Cyclic Graphical Representations of Feedback Models , 1995, UAI.

[22]  J. Tinbergen The Foundations of Econometric Analysis: Statistical Testing of Business Cycle Theories: Business Cycles in the United States of America, 1919–1932 (League of Nations, Geneva, 1939, vol. II, pp. 13–20) , 1995 .

[23]  J. Pearl,et al.  Logical and Algorithmic Properties of Conditional Independence and Graphical Models , 1993 .

[24]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[25]  A. Dawid Conditional Independence in Statistical Theory , 1979 .

[26]  J. Marschak Economic Interdependence and Statistical Analysis , 1974 .

[27]  H. Wold Causality and Econometrics , 1954 .

[28]  G. Orcutt,et al.  Toward Partial Redirection of Econometrics , 1952 .

[29]  Trygve Haavelmo Statistical Testing of Business-Cycle Theories , 1943 .

[30]  Henry Schultz,et al.  Studies in mathematical economics and econometrics : in memory of Henry Schultz , 1942 .

[31]  Wilbert G. Fritz,et al.  Statistical Testing of Business-Cycle Theories, Volume II: Business Cycles in the United States of America 1919-1932. , 1940 .