Simple Tests for Selection Bias: Learning More from Instrumental Variables

We provide simple tests for selection on unobserved variables in the Vytlacil-Imbens-Angrist framework for Local Average Treatment Effects. The tests allow researchers not only to test for selection on either or both of the treated and untreated outcomes, but also to assess the magnitude of the selection effect. The tests are quite simple; undergraduates after an introductory econometrics class should be able to implement these tests. We illustrate our tests with two empirical applications: the impact of children on female labor supply from Angrist and Evans (1998) and the training of adult women from the Job Training Partnership Act (JTPA) experiment.

[1]  Winston T. Lin,et al.  The Benefits and Costs of JTPA Title II-A Programs: Key Findings from the National Job Training Partnership Act Study , 1997 .

[2]  A simple test for the ignorability of non-compliance in experiments , 2013 .

[3]  James J. Heckman,et al.  Randomization as an Instrumental Variable , 1995 .

[4]  James J. Heckman,et al.  Using matching, instrumental variables and control functions to estimate economic choice models , 2004 .

[5]  J. Angrist,et al.  Children and Their Parents&Apos; Labor Supply: Evidence from Exogenous Variation in Family Size , 1996 .

[6]  Jeffrey A. Smith,et al.  Evaluating the Welfare State , 1998 .

[7]  G. Imbens.  Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review , 2004 .

[8]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1995 .

[9]  Joseph P. Romano,et al.  Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing , 2003 .

[10]  James J. Heckman,et al.  Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment , 2000 .

[11]  H. Ichimura,et al.  Treatment Evaluation With Selective Participation and Ineligibles , 2013 .

[12]  R. Lalonde,et al.  Testing for Selection Bias , 2014, SSRN Electronic Journal.

[13]  E. Vytlacil.  Independence, Monotonicity, and Latent Index Models: An Equivalence Result , 2002 .

[14]  Michael Lechner,et al.  The performance of estimators based on the propensity score , 2013 .

[15]  D. Black,et al.  How robust is the evidence on the effects of college quality? Evidence from matching , 2004 .

[16]  James J Heckman,et al.  Understanding Instrumental Variables in Models with Essential Heterogeneity , 2006, The Review of Economics and Statistics.

[17]  J. Heckman,et al.  Testing the Correlated Random Coefficient Model , 2009, Journal of econometrics.

[18]  Howard S. Bloom,et al.  Accounting for No-Shows in Experimental Evaluation Designs , 1984 .

[19]  Juan-José Díaz,et al.  An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator , 2006, The Journal of Human Resources.

[20]  James J. Heckman,et al.  Characterizing Selection Bias Using Experimental Data , 1998 .

[21]  David S. Lee,et al.  Regression Discontinuity Designs in Economics , 2009 .

[22]  Matías Busso,et al.  New Evidence on the Finite Sample Properties of Propensity Score Reweighting and Matching Estimators , 2014, Review of Economics and Statistics.

[23]  Alberto Abadie.  Semiparametric instrumental variable estimation of treatment response models , 2003 .

[24]  Kevin M. Murphy,et al.  Estimation and Inference in Two-Step Econometric Models , 1985 .

[25]  Lowell J. Taylor,et al.  The Impact of the Great Migration on Mortality of African Americans: Evidence from the Deep South. , 2015, The American economic review.

[26]  Joseph P. Romano,et al.  Stepup procedures for control of generalizations of the familywise error rate , 2006, math/0611266.

[27]  A. Roy.  Some thoughts on the distribution of earnings , 1951 .

[28]  Robert J. LaLonde,et al.  The Impact of Being Offered and Receiving Classroom Training on the Employment Histories of Disadvantaged Women: Evidence from Experimental Data , 1997 .

[29]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[30]  Guido W. Imbens,et al.  External Validity in Fuzzy Regression Discontinuity Designs , 2014, Journal of Business & Economic Statistics.

[31]  Richard K. Crump,et al.  Dealing with limited overlap in estimation of average treatment effects , 2009 .

[32]  J. Heckman.  Sample selection bias as a specification error , 1979 .

[33]  J. Angrist,et al.  Extrapolate-Ing: External Validity and Overidentification in the Late Framework , 2010 .

[34]  C. S. Reichardt,et al.  Regression-discontinuity designs. , 2012 .

[35]  J. Heckman,et al.  The Economics and Econometrics of Active Labor Market Programs , 1999 .

[36]  R. Blundell,et al.  Evaluating the effect of education on earnings: models, methods and results from the National Child Development Survey , 2005 .

[37]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme , 1997 .

[38]  Dan A. Black,et al.  Estimating the Returns to College Quality with Multiple Proxies for Quality , 2006, Journal of Labor Economics.

[39]  Joshua D. Angrist,et al.  Identification of Causal Effects Using Instrumental Variables , 1993 .

[40]  J. Heckman,et al.  Matching as an econometric estimator , 1998 .