Asymptotic minimax rates for abstract linear estimators

Abstract Abstract linear estimation concerns the estimation of an abstract parameter that depends on the underlying density via a linear transformation. An important subclass is the class of inverse problems where this transformation is naturally described as the inverse of some bounded operator. Suitable preconditioning allows us to restrict ourselves to the inverse of some Hermitian operator, which does not remain restricted to the class of compact operators. A lower bound to the minimax risk is obtained for the class of all estimators satisfying a natural moment condition and certain submodels. To establish the bound we use the Bayesian van Trees inequality and systems of (pseudo) eigenvectors of the operator involved. We also briefly sketch a general construction method for estimators, based on a regularized inverse of the operator involved, and show that these estimators attain the asymptotic minimax rate in interesting examples.

[1]  D. Donoho,et al.  Minimax Risk Over Hyperrectangles, and Implications , 1990 .

[2]  G. Wahba.  Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy , 1977 .

[3]  Jianqing Fan,et al.  Global Behavior of Deconvolution Kernel Estimates , 1989 .

[4]  Bernard W. Silverman,et al.  Discretization effects in statistical inverse problems , 1991, J. Complex..

[5]  P. Speckman.  Spline Smoothing and Optimal Rates of Convergence in Nonparametric Regression Models , 1985 .

[6]  Cun-Hui Zhang.  Fourier Methods for Estimating Mixing Densities and Distributions , 1990 .

[7]  F. Ruymgaart,et al.  Cross-validation for Parameter Selection in Inverse Estimation Problems , 1996 .

[8]  R. Kress.  Linear Integral Equations , 1989 .

[9]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[10]  M. C. Jones,et al.  Spline Smoothing and Nonparametric Regression. , 1989 .

[11]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[12]  D. Nychka,et al.  CONVERGENCE RATES FOR REGULARIZED SOLUTIONS OF INTEGRAL EQUATIONS FROM DISCRETE NOISY DATA , 1989 .

[13]  M. Nussbaum.  Spline Smoothing in Regression Models and Asymptotic Efficiency in $L_2$ , 1985 .

[14]  A. E. Hoerl,et al.  Ridge Regression: Applications to Nonorthogonal Problems , 1970 .

[15]  Raymond J. Carroll,et al.  Theoretical aspects of ill-posed problems in statistics , 1991 .

[16]  P. Hall,et al.  Rate of convergence of the empirical radon transform , 1993 .

[17]  M. Bertero.  Linear Inverse and III-Posed Problems , 1989 .

[18]  Didier Chauveau,et al.  Regularized Inversion of Noisy Laplace Transforms , 1994 .

[19]  R. Gill,et al.  Applications of the van Trees inequality : a Bayesian Cramr-Rao bound , 1995 .

[20]  P. Halmos.  What Does the Spectral Theorem Say , 1963 .

[21]  Bernard W. Silverman,et al.  Speed of Estimation in Positron Emission Tomography and Related Inverse Problems , 1990 .

[22]  L. Devroye.  A Course in Density Estimation , 1987 .