Testing for No Effect When Estimating a Smooth Function by Nonparametric Regression: A Randomization Approach

Abstract When a linear regression function is estimated by ordinary least squares, the null hypothesis of no relationship between the response and the design variable can be tested by the normal theory F test. This article describes a new test for use in the case in which a smooth regression function is estimated by a nonparametric procedure such as kernel estimation or local regression. The test is constructed as an approximation to an exact permutation test. The test statistic is the ratio of sums of squares that are defined by analogy to the analysis of variance. The null permutation distribution of the test statistic is approximated by matching its exact mean and variance to the moments of a gamma distribution. A simulation study shows that the approximation is excellent for several regression procedures and for normal, heavy-tailed, and skewed error distributions. Simulation results are also used to investigate the power of the test as a function of the smoothing parameter. The test is applied to dat...

[1]  M. Hutchinson,et al.  Smoothing noisy data with spline functions , 1985 .

[2]  G. Wahba.  Smoothing noisy data with spline functions , 1975 .

[3]  H. Scheffé,et al.  The Analysis of Variance , 1960 .

[4]  Jerome H. Friedman,et al.  Smoothing of Scatterplots , 1982 .

[5]  Takemi Yanagimoto,et al.  The use of marginal likelihood for a diagnostic test for the goodness of fit of the simple linear regression model , 1987 .

[6]  J. Levy,et al.  Clinical, immunologic, and serologic findings in men at risk for acquired immunodeficiency syndrome. The San Francisco Men's Health Study. , 1987, JAMA.

[7]  Gary O. Zerbe,et al.  Randomization Analysis of the Completely Randomized Design Extended to Growth and Response Curves , 1979 .

[8]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[9]  R. John,et al.  Boundary modification for kernel regression , 1984 .

[10]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[11]  Oscar Kempthorne,et al.  THE RANDOMIZATION THEORY OF' EXPERIMENTAL INFERENCE* , 1955 .

[12]  D. Cox,et al.  A smoothing spline based test of model adequacy in polynomial regression , 1989 .

[13]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[14]  B. L. Welch.  ON THE z-TEST IN RANDOMIZED BLOCKS AND LATIN SQUARES , 1937 .

[15]  B. Silverman,et al.  Some Aspects of the Spline Smoothing Approach to Non‐Parametric Regression Curve Fitting , 1985 .

[16]  E. Pitman.  Significance Tests Which May be Applied to Samples from Any Populations , 1937 .

[17]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[18]  E. Nadaraya.  On Estimating Regression , 1964 .

[19]  H. Müller.  Weighted Local Regression and Kernel Methods for Nonparametric Curve Fitting , 1987 .

[20]  J. Ramberg,et al.  The johnson translation system in monte carlo studies , 1982 .

[21]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[22]  E. Pitman.  SIGNIFICANCE TESTS WHICH MAY BE APPLIED TO SAMPLES FROM ANY POPULATIONS III. THE ANALYSIS OF VARIANCE TEST , 1938 .

[23]  Grace Wahba,et al.  Testing the (Parametric) Null Model Hypothesis in (Semiparametric) Partial and Generalized Spline Models , 1988 .