Graphical Methods for Investigating the Size and Power of Hypothesis Tests

Simple techniques for the graphical display of simulation evidence concerning the size and power of hypothesis tests are developed and illustrated. Three types of figures--called P value plots, P value discrepancy plots, and size-power curves--are discussed. Some Monte Carlo experiments on the properties of alternative forms of the information matrix test for linear regression models and probit models are used to illustrate these figures. Tests based on the outer-product-of-the-gradient regression generally perform much worse in terms of both size and power than efficient score tests. Copyright 1998 by Blackwell Publishers Ltd and The Victoria University of Manchester

[1]  James G. MacKinnon,et al.  THE SIZE DISTORTION OF BOOTSTRAP TESTS , 1999, Econometric Theory.

[2]  Likelihood Ratio Specification Tests , 1997 .

[3]  J. MacKinnon,et al.  The Size and Power of Bootstrap Tests , 1996 .

[4]  J. MacKinnon,et al.  The Size Distorsion of Bootstrap Tests , 1996 .

[5]  James G. MacKinnon,et al.  The Power of Bootstrap Tests , 1996 .

[6]  Francisco Cribari‐Neto.  On the corrections to information matrix tests , 1996 .

[7]  David W. Wilcox,et al.  A Comparison of Alternative Instruments Variables Estimators of a Dynamic Linear Model , 1995 .

[8]  J. Horowitz.  Bootstrap Methods in Econometrics: Theory and Numerical Performance , 1995 .

[9]  David W. Wilcox,et al.  A Comparison of Alternative Instrumental Variables Estimators of a Dynamic Linear Model , 1994 .

[10]  J. MacKinnon,et al.  Estimation and inference in econometrics , 1994 .

[11]  James G. MacKinnon,et al.  Regression-based methods for using control variates in Monte Carlo experiments , 1992 .

[12]  E. Mammen.  When Does Bootstrap Work?: Asymptotic Results and Simulations , 1992 .

[13]  E. Mammen.  When does bootstrap work , 1992 .

[14]  James G. MacKinnon,et al.  A New Form of the Information Matrix Test , 1992 .

[15]  J. Horowitz.  Bootstrap-based critical values for the information matrix test , 1994 .

[16]  Andrew Chesher,et al.  Asymptotic expansions of the informa-tion matrix test statistic , 1991 .

[17]  Chris D. Orme,et al.  The Calculation of the Information Matrix Test for Binary Data Models , 1988 .

[18]  R. Beran.  Prepivoting Test Statistics: A Bootstrap View of Asymptotic Refinements , 1988 .

[19]  Larry W. Taylor,et al.  The size bias of White's information matrix test , 1987 .

[20]  Alastair R. Hall,et al.  The Information Matrix Test for the Linear Model , 1987 .

[21]  Tony Lancaster,et al.  THE COVARIANCE MATRIX OF THE INFORMATION MATRIX TEST , 1984 .

[22]  James G. MacKinnon,et al.  Model Specification Tests Based on Artificial Linear Regressions , 1984 .

[23]  David F. Hendry,et al.  Monte carlo experimentation in econometrics , 1984 .

[24]  Andrew Chesher,et al.  The information matrix test: Simplified calculation via a score test interpretation , 1983 .

[25]  H. White.  Maximum Likelihood Estimation of Misspecified Models , 1982 .

[26]  L. E. Bredinin,et al.  [New form of information]. , 1971, Farmatsiia.

[27]  R. Gnanadesikan,et al.  Probability plotting methods for the analysis of data. , 1968, Biometrika.