This paper considers the use of instrumental variables to estimate the mean effect of treatment on the treated. It reviews previous work on this topic by Heckman and Robb (1985, 1986) and demonstrates that (a) unless the effect of treatment is the same for everyone (conditional on observables), or (b) treatment effects are variable across persons but the person-specific component of the variability not forecastable by observables does not determine participation in the program, widely-used instrumental variable methods produce inconsistent estimators of the parameter of interest. Neither assumption is very palatable. The first assumes a homogeneity that is implausible. The second assumes either very rich data available to the econometrician or that the persons being studied either do not have better information than the econometrician or that they do not use it. Instrumental variable methods do not provide a general solution to the evaluation problem.
[1]
J. Heckman.
Dummy Endogenous Variables in a Simultaneous Equation System
,
1977
.
[2]
Joshua D. Angrist,et al.
Identification of Causal Effects Using Instrumental Variables
,
1993
.
[3]
Jeffrey A. Smith,et al.
Making the Most Out of Social Experiments: Reducing the Intrinsic Uncertainty in Evidence from Randomized Trials with an Application to the Jtpa Exp
,
1994
.
[4]
Joshua D. Angrist,et al.
Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records
,
1990
.
[5]
R. Lalonde.
Evaluating the Econometric Evaluations of Training Programs with Experimental Data
,
1984
.
[6]
Bo E. Honoré,et al.
The Empirical Content of the Roy Model
,
1990
.