Nonparametric Tests of Conditional Treatment Effects

We develop a general class of nonparametric tests for treatment effects conditional on covariates. We consider a wide spectrum of null and alternative hypotheses regarding conditional treatment effects, including (i) the null hypothesis of the conditional stochastic dominance between treatment and control groups; ii) the null hypothesis that the conditional average treatment effect is positive for each value of covariates; and (iii) the null hypothesis of no distributional (or average) treatment effect conditional on covariates against a one-sided (or two-sided) alternative hypothesis. The test statistics are based on L1-type functionals of uniformly consistent nonparametric kernel estimators of conditional expectations that characterize the null hypotheses. Using the Poissionization technique of Gine et al. (2003), we show that suitably studentized versions of our test statistics are asymptotically standard normal under the null hypotheses and also show that the proposed nonparametric tests are consistent against general fixed alternatives. Furthermore, it turns out that our tests have non-negligible powers against some local alternatives that are n−½ different from the null hypotheses, where n is the sample size. We provide a more powerful test for the case when the null hypothesis may be binding only on a strict subset of the support and also consider an extension to testing for quantile treatment effects. We illustrate the usefulness of our tests by applying them to data from a randomized, job training program (LaLonde, 1986) and by carrying out Monte Carlo experiments based on this dataset.

[1]  C. Manski.  Statistical treatment rules for heterogeneous populations , 2003 .

[2]  R. Davidson,et al.  Statistical Inference for Stochastic Dominance and for the Measurement of Poverty and Inequality , 1998 .

[3]  O. Linton,et al.  Nonparametric Estimation of a Polarization Measure , 2009 .

[4]  Sergio Firpo.  Efficient Semiparametric Estimation of Quantile Treatment Effects , 2004 .

[5]  Rabindra N Bhattacharya.  On Errors of Normal Approximation , 1975 .

[6]  Petra E. Todd,et al.  Matching As An Econometric Evaluation Estimator , 1998 .

[7]  Esther Duflo,et al.  Women as Policy Makers: Evidence from a Randomized Experiment , 2010 .

[8]  Monica Costa Dias,et al.  Alternative approaches to evaluation in empirical microeconomics , 2002, The Journal of Human Resources.

[9]  J. Angrist,et al.  Causal Effects of Monetary Shocks: Semiparametric Conditional Independence Tests with a Multinomial Propensity Score , 2011, Review of Economics and Statistics.

[10]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[11]  Rajeev Dehejia,et al.  Propensity Score-Matching Methods for Nonexperimental Causal Studies , 2002, Review of Economics and Statistics.

[12]  Probal Chaudhuri,et al.  Nonparametric Estimates of Regression Quantiles and Their Local Bahadur Representation , 1991 .

[13]  Harshinder Singh,et al.  Testing for Second-Order Stochastic Dominance of Two Distributions , 1994, Econometric Theory.

[14]  A. Cuevas,et al.  A plug-in approach to support estimation , 1997 .

[15]  G. Imbens,et al.  Large Sample Properties of Matching Estimators for Average Treatment Effects , 2004 .

[16]  Donald W. K. Andrews,et al.  Nonparametric Kernel Estimation for Semiparametric Models , 1995, Econometric Theory.

[17]  E. Giné,et al.  The $\bm{L}_\mathbf{1}$-norm density estimator process , 2003 .

[18]  Oliver Linton,et al.  An Improved Bootstrap Test of Stochastic Dominance , 2009 .

[19]  Prakasa Rao.  Nonparametric functional estimation , 1983 .

[20]  J. Angrist,et al.  Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings , 1999 .

[21]  Edward Miguel,et al.  Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities, Guide to Replication of Miguel and Kremer (2004) , 2014 .

[22]  I. Gijbels,et al.  Bandwidth Selection in Nonparametric Kernel Testing , 2008 .

[23]  V. Chernozhukov,et al.  An IV Model of Quantile Treatment Effects , 2002 .

[24]  H. White,et al.  A NONPARAMETRIC HELLINGER METRIC TEST FOR CONDITIONAL INDEPENDENCE , 2008, Econometric Theory.

[25]  M. C. Jones,et al.  Testing Monotonicity of Regression , 1998 .

[26]  Kjell A. Doksum,et al.  On average derivative quantile regression , 1997 .

[27]  James J. Heckman,et al.  Econometric Evaluation of Social Programs, Part II: Using the Marginal Treatment Effect to Organize Alternative Econometric Estimators to Evaluate Social Programs, and to Forecast their Effects in New Environments , 2007 .

[28]  E. Mammen,et al.  Identification and Estimation of Local Average Derivatives in Non-Separable Models Without Monotonicity , 2009 .

[29]  D. Pollard.  Convergence of stochastic processes , 1984 .

[30]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[31]  Gordon Anderson,et al.  Nonparametric Tests of Stochastic Dominance in Income Distributions , 1996 .

[32]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1995 .

[33]  Piotr Kokoszka,et al.  Testing for stochastic dominance using the weighted McFadden-type statistic , 2006 .

[34]  D. McFadden.  Testing for Stochastic Dominance , 1989 .

[35]  Wenceslao González Manteiga,et al.  Significance testing in nonparametric regression based on the bootstrap , 2001 .

[36]  D. Mason,et al.  Asymptotic normality of plug-in level set estimates. , 2009, 0908.1045.

[37]  Jianqing Fan,et al.  Robust Non-parametric Function Estimation , 1994 .

[38]  Alberto Abadie.  Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models , 2002 .

[39]  J. Hahn.  On the Role of the Propensity Score in Efficient Semiparametric Estimation of Average Treatment Effects , 1998 .

[40]  Richard K. Crump,et al.  Nonparametric Tests for Treatment Effect Heterogeneity , 2006, The Review of Economics and Statistics.

[41]  Xiaohong Chen,et al.  Semiparametric efficiency in GMM models with auxiliary data , 2007, 0705.0069.

[42]  V. V. Shergin.  Central limit theorem for finitely-dependent random variables , 1993 .

[43]  R. Davidson,et al.  Statistical Inference for the Measurement of the Incidence of Taxes and Transfers , 1997 .

[44]  Quang Vuong,et al.  Nonparametric Identification of Risk Aversion in First‐Price Auctions Under Exclusion Restrictions , 2009 .

[45]  Myoung‐jae Lee.  Non‐parametric tests for distributional treatment effect for randomly censored responses , 2009 .

[46]  G. Imbens,et al.  Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score , 2000 .

[47]  V. Chernozhukov,et al.  Inference on Counterfactual Distributions , 2009, 0904.0951.

[48]  Stephen G. Donald,et al.  Consistent Tests for Stochastic Dominance , 2003 .

[49]  Arusharka,et al.  TESTING MONOTONICITY OF REGRESSIONBy , 1998 .

[50]  G. Harrison,et al.  Field experiments , 1924, The Journal of Agricultural Science.

[51]  J. Angrist,et al.  Identification and Estimation of Local Average Treatment Effects , 1994 .

[52]  Sokbae Lee,et al.  Intersection bounds: estimation and inference , 2009, 0907.3503.

[53]  Majorization, exponential inequalities and almost sure behavior of vector-valued random variables , 1991 .

[54]  Jonah B. Gelbach,et al.  Distributional Impacts of the Self-Sufficiency Project , 2005 .

[55]  Jeffrey A. Smith,et al.  Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators? , 2000 .

[56]  P. Lavergne,et al.  An equality test across nonparametric regressions , 2001 .

[57]  John E. Kolassa,et al.  Asymptotic Normality , 2011, International Encyclopedia of Statistical Science.

[58]  James J. Heckman,et al.  Econometric Evaluation of Social Programs, Part I: Causal Models, Structural Models and Econometric Policy Evaluation , 2007 .

[59]  Kyungchul Song.  Testing Conditional Independence via Rosenblatt Transforms , 2007 .

[60]  J J Heckman,et al.  Local instrumental variables and latent variable models for identifying and bounding treatment effects. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[61]  O. Linton,et al.  Consistent Testing for Stochastic Dominance: A Subsampling Approach , 2002 .

[62]  J. Heckman,et al.  Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation , 2007 .

[63]  R. Lalonde.  Evaluating the Econometric Evaluations of Training Programs with Experimental Data , 1984 .

[64]  O. Linton,et al.  Consistent Testing for Stochastic Dominance Under General Sampling Schemes , 2003 .

[65]  David Card,et al.  Estimating the Effects of a Time Limited Earnings Subsidy for Welfare Leavers , 2004 .