Deterministic/Stochastic Wavelet Decomposition for Recovery of Signal From Noisy Data

In a series of recent articles on nonparametric regression, Donoho and Johnstone developed waveletshrinkage methods for recovering unknown piecewise-smooth deterministic signals from noisy data. Wavelet shrinkage based on the Bayesian approach involves specifying a prior distribution on the wavelet coefficients, which is usually assumed to have a distribution with zero mean. There is no a priori reason why all prior means should be 0; indeed, one can imagine certain types of signals in which this is not a good choice of model. In this article, we take an empirical Bayes approach in which we propose an estimator for the prior mean that is “plugged into” the Bayesian shrinkage formulas. Another way we are more general than previous work is that we assume that the underlying signal is composed of a piecewise-smooth deterministic part plus a zero-mean stochastic part; that is, the signal may contain a reasonably large number of nonzero wavelet coefficients. Our goal is to predict this signal from noisy data. We also develop a new estimator for the noise variance based on a geostatistical method that considers the behavior of the variogram near the origin. Simulation studies show that our method (DecompShrink) outperforms the wellknown VisuShrink and SureShrink methods for recovering a wide variety of signals. Moreover, it is insensitive to the choice of the lowest-scale cut-off parameter, which is typically not the case for other wavelet-shrinkage methods.

[1]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[2]  P. P. Vaidyanathan,et al.  An Introduction to Wavelet Transforms , 1994 .

[3]  Y. Benjamini,et al.  Thresholding of Wavelet Coefficients as Multiple Hypotheses Testing Procedure , 1995 .

[4]  Su-Yun Huang,et al.  BAYESIAN WAVELET SHRINKAGE FOR NONPARAMETRIC MIXED-EFFECTS MODELS , 2000 .

[5]  Andrew Harvey,et al.  Forecasting, Structural Time Series Models and the Kalman Filter , 1990 .

[6]  I. Johnstone,et al.  Wavelet Threshold Estimators for Data with Correlated Noise , 1997 .

[7]  G. Nason Choice of the Threshold Parameter in Wavelet Function Estimation , 1995 .

[8]  K. C. Chou,et al.  Multiscale systems, Kalman filters, and Riccati equations , 1994, IEEE Trans. Autom. Control..

[9]  Emanuel Parzen,et al.  Change-point approach to data analytic wavelet thresholding , 1996, Stat. Comput..

[10]  I. Johnstone,et al.  Adapting to Unknown Smoothness via Wavelet Shrinkage , 1995 .

[11]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[12]  G. Nason Wavelet Shrinkage using Cross-validation , 1996 .

[13]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[14]  I. Johnstone,et al.  Wavelet Shrinkage: Asymptopia? , 1995 .

[15]  R. A. Boyles On the Convergence of the EM Algorithm , 1983 .

[16]  Y. Meyer Wavelets and Operators , 1993 .

[17]  Su-Yun Huang,et al.  Wavelet Shrinkage for Nonparametric Mixed-eeects Models , 1997 .

[18]  Gail Gong,et al.  Pseudo Maximum Likelihood Estimation: Theory and Applications , 1981 .

[19]  B. Silverman,et al.  Wavelet Thresholding via a Bayesian , 1996 .

[20]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[21]  Sujit K. Ghosh,et al.  Essential Wavelets for Statistical Applications and Data Analysis , 2001, Technometrics.

[22]  E. Parzen,et al.  Data dependent wavelet thresholding in nonparametric regression with change-point applications , 1996 .

[23]  BayesFactorsBrani Vidakovic Nonlinear Wavelet Shrinkage With Bayes Rules and , 1998 .

[24]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  B. Vidakovic Nonlinear wavelet shrinkage with Bayes rules and Bayes factors , 1998 .

[26]  Brani Vidakovic,et al.  Wavelet Shrinkage with Aane Bayes Rules with Applications , 1995 .

[27]  D. Kell,et al.  An introduction to wavelet transforms for chemometricians: A time-frequency approach , 1997 .

[28]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[29]  M. Clyde,et al.  Multiple shrinkage and subset selection in wavelets , 1998 .

[30]  Robert D. Nowak,et al.  Wavelet-based statistical signal processing using hidden Markov models , 1998, IEEE Trans. Signal Process..

[31]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[32]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[33]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[34]  E. George,et al.  APPROACHES FOR BAYESIAN VARIABLE SELECTION , 1997 .

[35]  H. Chipman,et al.  Adaptive Bayesian Wavelet Shrinkage , 1997 .

[36]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[37]  Andrew Harvey,et al.  Forecasting, structural time series models and the Kalman filter: Selected answers to exercises , 1990 .

[38]  R. Ogden,et al.  Essential Wavelets for Statistical Applications and Data Analysis , 1996 .

[39]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[40]  B. Silverman,et al.  Wavelet thresholding via a Bayesian approach , 1998 .

[41]  I. Daubechies,et al.  Wavelets on the Interval and Fast Wavelet Transforms , 1993 .

[42]  Y. Benjamini,et al.  Adaptive thresholding of wavelet coefficients , 1996 .

[43]  Wim Sweldens,et al.  An Overview of Wavelet Based Multiresolution Analyses , 1994, SIAM Rev..