THE SIZE DISTORTION OF BOOTSTRAP TESTS

We provide a theoretical framework in which to study the accuracy of bootstrap P values, which may be based on a parametric or nonparametric bootstrap. In the parametric case, the accuracy of a bootstrap test will depend on the shape of what we call the critical value function. We show that, in many circumstances, the error in rejection probability of a bootstrap test will be one whole order of magnitude smaller than that of the corresponding asymptotic test. We also propose a simulation method for estimating this error that requires the calculation of only two test statistics per replication.

[1]  J. MacKinnon,et al.  Estimation and inference in econometrics , 1994 .

[2]  R. Beran.  Prepivoting Test Statistics: A Bootstrap View of Asymptotic Refinements , 1988 .

[3]  James G. MacKinnon,et al.  Regression-based methods for using control variates in Monte Carlo experiments , 1992 .

[4]  E. Mammen.  The Bootstrap and Edgeworth Expansion , 1997 .

[5]  C. Attfield,et al.  A Bartlett adjustment to the likelihood ratio test for a system of equations , 1995 .

[6]  P. Hall,et al.  The Effect of Simulation Order on Level Accuracy and Power of Monte Carlo Tests , 1989 .

[7]  Joel L. Horowitz,et al.  Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators , 1996 .

[8]  J. MacKinnon,et al.  Bootstrap Testing in Nonlinear Models , 1999 .

[9]  Thomas J Rothernberg.  HYPOTHESIS TESTING IN LINEAR MODELS WHEN THE ERROR COVARIANCE MATRIX IS NONSCALAR , 1984 .

[10]  N. Weber.  On resampling techniques for regression models , 1984 .

[11]  James G. MacKinnon,et al.  Implicit Alternatives and the Local Power of Test Statistics , 1987 .

[12]  R. Beran.  Simulated Power Functions , 1986 .

[13]  Leslie Godfrey,et al.  Tests of non-nested regression models some results on small sample behaviour and the bootstrap , 1998 .

[14]  Leslie Godfrey,et al.  Tests of non-nested regression models: Small sample adjustments and Monte Carlo evidence , 1983 .

[15]  R. Tibshirani,et al.  An introduction to the bootstrap , 1993 .

[16]  Li Qi,et al.  Bootstrapping J-type tests for non-nested regression models , 1995 .

[17]  J. Horowitz.  Bootstrap-based critical values for the information matrix test , 1994 .

[18]  J. MacKinnon,et al.  Several Tests for Model Specication in the Pres-ence of Alternative Hypotheses , 1981 .

[19]  Robert K. Rayner.  Bootstrapping p Values and Power in the First-Order Autoregression: A Monte Carlo Investigation , 1990 .