Asymptotically Minimax Nonparametric Regression in L2

Additive nonparametric regression with equidistant observation design is considered. The Pinsker-type minimax results are derived and the linear asymptotically minimax estimators are exhibited, based on approximation of the initial nonparametric model by a linear models of dimension which is increasing with the number of observations. The proof of optimality of these linear estimators within the class of all possible estimators is based on the rather elementary but very useful van Trees inequality.

[1]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[2]  L. Brown,et al.  Asymptotic equivalence of nonparametric regression and white noise , 1996 .

[3]  M. Nussbaum.  Asymptotic Equivalence of Density Estimation and Gaussian White Noise , 1996 .

[4]  Sam Efromovich,et al.  On nonparametric regression for IID observations in a general setting , 1996 .

[5]  R. Gill,et al.  Applications of the van Trees inequality : a Bayesian Cramr-Rao bound , 1995 .

[6]  A. Korostelev.  An Asymptotically Minimax Regression Estimator in the Uniform Norm up to Exact Constant , 1994 .

[7]  A. Korostelev,et al.  Pseudovalues and minimax filtering algorithms for the nonparametric median , 1992 .

[8]  M. Nussbaum,et al.  A Risk Bound in Sobolev Class Regression , 1990 .

[9]  M. Nussbaum.  Spline Smoothing in Regression Models and Asymptotic Efficiency in $L_2$ , 1985 .

[10]  P. Speckman.  Spline Smoothing and Optimal Rates of Convergence in Nonparametric Regression Models , 1985 .

[11]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[12]  I. A. Ibragimov,et al.  Bounds for the Risks of Non-Parametric Regression Estimates , 1982 .

[13]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[14]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[15]  D. Pollard.  Convergence of stochastic processes , 1984 .

[16]  R. Z. Khasʹminskiĭ,et al.  Statistical estimation : asymptotic theory , 1981 .