Wavelet Estimation of an Unknown Function Observed with Correlated Noise

In many practical applications of nonparametric regression, it is desirable to allow for the possibility that the noise is correlated. In this article, we focus on wavelet-based nonparametric function estimation and propose two distinct methods for estimating the correlation structure of the noise, one based in the time domain and the other based in the wavelet domain. Once the correlation structure has been estimated, there are various methods that may be used for reconstructing the unknown signal; we focus here on the empirical Bayes block shrinkage method proposed by Wang and Wood (2006). A simulation study is described. Our numerical results indicate that the proposed methods do a good job of reconstructing the signal even when the noise is highly correlated.

[1]  Bernard W. Silverman,et al.  EbayesThresh: R Programs for Empirical Bayes Thresholding , 2005 .

[2]  J. Besag.  Statistical Analysis of Non-Lattice Data , 1975 .

[3]  M. M. Siddiqui.  On the Inversion of the Sample Covariance Matrix in a Stationary Autoregressive Process , 1958 .

[4]  H. Chipman,et al.  Adaptive Bayesian Wavelet Shrinkage , 1997 .

[5]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[6]  P. Hall,et al.  Block threshold rules for curve estimation using kernel and wavelet methods , 1998 .

[7]  Brani Vidakovic,et al.  Wavelet Bayesian Block Shrinkage via Mixtures of Normal-Inverse Gamma Priors , 2004 .

[8]  I. Johnstone,et al.  Wavelet Shrinkage: Asymptopia? , 1995 .

[9]  Nicholas I. Fisher,et al.  On the Nonparametric Estimation of Covariance Functions , 1994 .

[10]  T. Tony Cai,et al.  ON BLOCK THRESHOLDING IN WAVELET REGRESSION: ADAPTIVITY, BLOCK SIZE, AND THRESHOLD LEVEL , 2002 .

[11]  I. Johnstone,et al.  Wavelet Threshold Estimators for Data with Correlated Noise , 1997 .

[12]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[13]  Y. Benjamini,et al.  Adaptive thresholding of wavelet coefficients , 1996 .

[14]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[15]  Andrew T. A. Wood,et al.  Empirical Bayes block shrinkage of wavelet coefficients via the noncentral χ2 distribution , 2006 .

[16]  G. Nason.  Wavelet Shrinkage using Cross-validation , 1996 .

[17]  M. Vannucci,et al.  Covariance structure of wavelet coefficients: theory and models in a Bayesian perspective , 1999 .

[18]  Y. Meyer.  Wavelets and Operators , 1993 .

[19]  Harrison H. Zhou,et al.  A data-driven block thresholding approach to wavelet estimation , 2009, 0903.5147.

[20]  G. Weiss,et al.  Littlewood-Paley Theory and the Study of Function Spaces , 1991 .

[21]  Peter Whittle,et al.  Probability, statistics and optimisation : a tribute to Peter Whittle , 1995 .

[22]  Yuhong Yang,et al.  Nonparametric Regression with Correlated Errors , 2001 .

[23]  I. Johnstone,et al.  Empirical Bayes selection of wavelet thresholds , 2005, math/0508281.

[24]  M. Clyde,et al.  Multiple shrinkage and subset selection in wavelets , 1998 .

[25]  P. Besbeas,et al.  Empirical Bayes approach to block wavelet function estimation , 2002 .

[26]  David R. Cox,et al.  The Theory of Stochastic Processes , 1967, The Mathematical Gazette.

[27]  J. Besag.  Efficiency of pseudolikelihood estimation for simple Gaussian fields , 1977 .