Effect of mean on variance function estimation in nonparametric regression

Variance function estimation in nonparametric regression is considered and the minimax rate of convergence is derived. We are particularly interested in the effect of the unknown mean on the estimation of the variance function. Our results indicate that, contrary to the common practice, it is not desirable to base the estimator of the variance function on the residuals from an optimal estimator of the mean when the mean function is not smooth. Instead it is more desirable to use estimators of the mean with minimal bias. On the other hand, when the mean function is very smooth, our numerical results show that the residual-based method performs better, but not substantial better than the first-order-difference-based estimator. In addition our asymptotic results also correct the optimal rate claimed in Hall and Carroll [J. Roy. Statist. Soc. Ser. B51 (1989) 3-14].

[1]  David Ruppert,et al.  Local polynomial variance-function estimation , 1997 .

[2]  H. Müller,et al.  On variance function estimation with quadratic forms , 1993 .

[3]  John von Neumann,et al.  A Further Remark Concerning the Distribution of the Ratio of the Mean Square Successive Difference to the Variance , 1942 .

[4]  J. Neumann.  Distribution of the Ratio of the Mean Square Successive Difference to the Variance , 1941 .

[5]  M. Rosenblatt.  Remarks on Some Nonparametric Estimates of a Density Function , 1956 .

[6]  W. J. Studden,et al.  Tchebycheff Systems: With Applications in Analysis and Statistics. , 1967 .

[7]  H. Müller,et al.  Kernels for Nonparametric Curve Estimation , 1985 .

[8]  Michael Levine.  Bandwidth selection for a class of difference-based variance estimators in the nonparametric regression: A possible approach , 2006, Comput. Stat. Data Anal..

[9]  J. Marron,et al.  On variance estimation in nonparametric regression , 1990 .

[10]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[11]  P. Hall,et al.  Asymptotically optimal difference-based estimation of variance in nonparametric regression , 1990 .

[12]  Nicolai Bissantz,et al.  On difference‐based variance estimation in nonparametric regression when the covariate is high dimensional , 2005 .

[13]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[14]  L. L. Cam,et al.  Asymptotic Methods In Statistical Decision Theory , 1986 .

[15]  H. Müller,et al.  Estimating regression functions and their derivatives by the kernel method , 1984 .

[16]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[17]  Jianqing Fan,et al.  Efficient Estimation of Conditional Variance Functions in Stochastic Regression , 1998 .

[18]  Ulrich Stadtmüller,et al.  Estimation of Heteroscedasticity in Regression Analysis , 1987 .

[19]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[20]  Michael H. Neumann.  Fully Data-Driven Nonparametric Variance Estimators , 1994 .

[21]  Lawrence D. Brown,et al.  Variance estimation in nonparametric regression via the difference sequence method , 2007, 0712.0898.

[22]  Raymond J. Carroll,et al.  Variance Function Estimation in Regression: the Effect of Estimating the Mean , 1988 .