Nonlinear estimation over weak Besov spaces and minimax Bayes method

Weak Besov spaces play important roles in statistics as maxisets of classical procedures or for measuring the sparsity of signals. The goal of this paper is to study weak Besov balls ${\cal WB}_{s,p,q}(C)$ from the statistical point of view by using the minimax Bayes method. In particular, we compare weak and strong Besov balls statistically. By building an optimal Bayes wavelet thresholding rule, we first establish that, under suitable conditions, the rate of convergence of the minimax risk for ${\cal WB}_{s,p,q}(C)$ is the same as for the strong Besov ball ${\cal B}_{s,p,q}(C)$ that is contained by ${\cal WB}_{s,p,q}(C)$. However, we show that the asymptotically least favorable priors of ${\cal WB}_{s,p,q}(C)$ that are based on Pareto distributions cannot be asymptotically least favorable priors for ${\cal B}_{s,p,q}(C)$. Finally, we present sample paths of such priors that provide representations of the worst functions to be estimated for classical procedures and we give an interpretation of the roles of the parameters $s$, $p$ and $q$ of ${\cal WB}_{s,p,q}(C)$.

[1]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[2]  I. Johnstone,et al.  Neo-classical minimax problems, thresholding and adaptive function estimation , 1996 .

[3]  Y. Meyer Wavelets and Operators , 1993 .

[4]  V. Rivoirard Thresholding procedure with priors based on Pareto distributions , 2004 .

[5]  I. Johnstone,et al.  Minimax risk overlp-balls forlp-error , 1994 .

[6]  A. Antoniadis Smoothing Noisy Data with Tapered Coiflets Series , 1996 .

[7]  G. Casella,et al.  Estimating a Bounded Normal Mean , 1981 .

[8]  B. Silverman,et al.  Wavelet thresholding via a Bayesian approach , 1998 .

[9]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[10]  R. DeVore,et al.  Restricted Nonlinear Approximation , 2000 .

[11]  D. Donoho Unconditional Bases and Bit-Level Compression , 1996 .

[12]  S. Mallat A wavelet tour of signal processing , 1998 .

[13]  P. Massart The Tight Constant in the Dvoretzky-Kiefer-Wolfowitz Inequality , 1990 .

[14]  Albert Cohen,et al.  Maximal Spaces with Given Rate of Convergence for Thresholding Algorithms , 2001 .

[15]  P. Bickel Minimax Estimation of the Mean of a Normal Distribution when the Parameter Space is Restricted , 1981 .

[16]  B. Vidakovic Nonlinear wavelet shrinkage with Bayes rules and Bayes factors , 1998 .

[17]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[18]  I. Johnstone Minimax Bayes, Asymptotic Minimax and Sparse Wavelet Priors , 1994 .

[19]  I. Johnstone,et al.  Adapting to unknown sparsity by controlling the false discovery rate , 2005, math/0505374.