Nonparametric Estimation of the Regression Function in an Errors-in-Variables Model

We consider the regression model with errors-in-variables where we observe $n$ i.i.d. copies of $(Y,Z)$ satisfying $Y=f(X)+\xi, Z=X+\sigma\epsilon$, involving independent and unobserved random variables $X,\xi,\epsilon$. The density $g$ of $X$ is unknown, whereas the density of $\sigma\epsilon$ is completely known. Using the observations $(Y\_i, Z\_i)$, $i=1,...,n$, we propose an estimator of the regression function $f$, built as the ratio of two penalized minimum contrast estimators of $\ell=fg$ and $g$, without any prior knowledge on their smoothness. We prove that its $\mathbb{L}\_2$-risk on a compact set is bounded by the sum of the two $\mathbb{L}\_2(\mathbb{R})$-risks of the estimators of $\ell$ and $g$, and give the rate of convergence of such estimators for various smoothness classes for $\ell$ and $g$, when the errors $\epsilon$ are either ordinary smooth or super smooth. The resulting rate is optimal in a minimax sense in all cases where lower bounds are available.

[1]  C. Butucea Deconvolution of supersmooth densities with smooth noise , 2004 .

[2]  D. Ruppert,et al.  Nonparametric regression in the presence of measurement error , 1999 .

[3]  P. Massart,et al.  Minimum contrast estimators on sieves: exponential bounds and rates of convergence , 1998 .

[4]  J. Koo,et al.  B-spline estimation of regression functions with errors in variable , 1998 .

[5]  D. Ioannides,et al.  Nonparametric regression with errors in variables and applications , 1997 .

[6]  M. Talagrand New concentration inequalities in product spaces , 1996 .

[7]  Jianqing Fan Local Polynomial Modelling and Its Applications: Monographs on Statistics and Applied Probability 66 , 1996 .

[8]  Jianqing Fan,et al.  Nonparametric regression with errors in variables , 1993 .

[9]  Jianqing Fan,et al.  Multivariate regression estimation with errors-in-variables: asymptotic normality for mixing processes , 1992 .

[10]  Jianqing Fan On the Optimal Rates of Convergence for Nonparametric Deconvolution Problems , 1991 .

[11]  H. Rosenthal On the subspaces ofLp(p>2) spanned by sequences of independent random variables , 1970 .

[12]  PENALIZED CONTRAST ESTIMATOR FOR DENSITY DECONVOLUTION , 2005 .

[13]  M. Ledoux On Talagrand's deviation inequalities for product measures , 1997 .

[14]  V. V. Petrov Limit theorems of probability theory: Sequences of independent random variables, by , 1996 .

[15]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[16]  E. Masry Multivariate regression estimation with errors-in-variables for stationary processes , 1993 .

[17]  Jianqing Fan,et al.  Nonparametric Function Estimation Involving Errors-in-Variables , 1991 .

[18]  Jianqing Fan,et al.  Global Behavior of Deconvolution Kernel Estimates , 1989 .