A data-driven block thresholding approach to wavelet estimation

A data-driven block thresholding procedure for wavelet regression is proposed and its theoretical and numerical properties are investigated. The procedure empirically chooses the block size and threshold level at each resolution level by minimizing Stein's unbiased risk estimate. The estimator is sharp adaptive over a class of Besov bodies and achieves simultaneously within a small constant factor of the minimax risk over a wide collection of Besov Bodies including both the ``dense'' and ``sparse'' cases. The procedure is easy to implement. Numerical results show that it has superior finite sample performance in comparison to the other leading wavelet thresholding estimators.

[1]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[2]  C. Stein.  Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[3]  H. Triebel.  Theory Of Function Spaces , 1983 .

[4]  S. Efroimovich.  Nonparametric Estimation of a Density of Unknown Smoothness , 1986 .

[5]  R. DeVore,et al.  Interpolation of Besov-Spaces , 1988 .

[6]  Gilbert Strang,et al.  Wavelets and Dilation Equations: A Brief Introduction , 1989, SIAM Rev..

[7]  D. Donoho,et al.  Minimax Risk Over Hyperrectangles, and Implications , 1990 .

[8]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[9]  Y. Meyer.  Wavelets and Operators , 1993 .

[10]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.

[11]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[12]  I. Johnstone,et al.  Minimax Risk over l p-Balls for l q-error , 1994 .

[13]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[14]  L. Breiman.  Better subset regression using the nonnegative garrote , 1995 .

[15]  G. Kerkyacharian,et al.  Adaptive Density Estimation , 1996 .

[16]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[17]  P. Hall,et al.  Block threshold rules for curve estimation using kernel and wavelet methods , 1998 .

[18]  Hong-Ye Gao,et al.  Wavelet Shrinkage Denoising Using the Non-Negative Garrote , 1998 .

[19]  P. Hall,et al.  ON THE MINIMAX OPTIMALITY OF BLOCK THRESHOLDED WAVELET ESTIMATORS , 1999 .

[20]  I. Johnstone.  WAVELET SHRINKAGE FOR CORRELATED DATA AND INVERSE PROBLEMS: ADAPTIVITY RESULTS , 1999 .

[21]  T. Cai.  Adaptive wavelet estimation : A block thresholding and oracle inequality approach , 1999 .

[22]  B. Silverman,et al.  Incorporating Information on Neighboring Coefficients Into Wavelet Estimation , 2001 .

[23]  Jianqing Fan,et al.  Regularization of Wavelet Approximations , 2001 .

[24]  I. Johnstone,et al.  Empirical Bayes selection of wavelet thresholds , 2005, math/0508281.

[25]  Eric Chicken,et al.  Block-dependent thresholding in wavelet regression , 2005 .

[26]  T. Cai,et al.  Block thresholding for density estimation: local and global adaptivity , 2005 .