ForWaRD: Fourier-wavelet regularized deconvolution for ill-conditioned systems

We propose an efficient, hybrid Fourier-wavelet regularized deconvolution (ForWaRD) algorithm that performs noise regularization via scalar shrinkage in both the Fourier and wavelet domains. The Fourier shrinkage exploits the Fourier transform's economical representation of the colored noise inherent in deconvolution, whereas the wavelet shrinkage exploits the wavelet domain's economical representation of piecewise smooth signals and images. We derive the optimal balance between the amount of Fourier and wavelet regularization by optimizing an approximate mean-squared error (MSE) metric and find that signals with more economical wavelet representations require less Fourier shrinkage. ForWaRD is applicable to all ill-conditioned deconvolution problems, unlike the purely wavelet-based wavelet-vaguelette deconvolution (WVD); moreover, its estimate features minimal ringing, unlike the purely Fourier-based Wiener deconvolution. Even in problems for which the WVD was designed, we prove that ForWaRD's MSE decays with the optimal WVD rate as the number of samples increases. Further, we demonstrate that over a wide range of practical sample-lengths, ForWaRD improves on WVD's performance.

[1]  J. Peetre New thoughts on Besov spaces , 1976 .

[2]  R. Edwards,et al.  Littlewood-Paley and Multiplier Theory , 1977 .

[3]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[4]  Roland T. Chin,et al.  Iterative Wiener filters for image restoration , 1991, IEEE Trans. Signal Process..

[5]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[6]  Ronald A. DeVore,et al.  Image compression through wavelet transform coding , 1992, IEEE Trans. Inf. Theory.

[7]  D. Donoho Unconditional Bases Are Optimal Bases for Data Compression and for Statistical Estimation , 1993 .

[8]  D. L. Donoho,et al.  Ideal spacial adaptation via wavelet shrinkage , 1994 .

[9]  Michael Unser,et al.  A general sampling theory for nonideal acquisition devices , 1994, IEEE Trans. Signal Process..

[10]  D. Donoho Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition , 1995 .

[11]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[12]  Aggelos K. Katsaggelos,et al.  Spatially adaptive wavelet-based multiscale image restoration , 1996, IEEE Trans. Image Process..

[13]  Richard G. Baraniuk,et al.  Improved wavelet denoising via empirical Wiener filtering , 1997, Optics & Photonics.

[14]  I. Johnstone,et al.  Minimax estimation via wavelet shrinkage , 1998 .

[15]  B. Silverman,et al.  Wavelet decomposition approaches to statistical inverse problems , 1998 .

[16]  Robert D. Nowak,et al.  Wavelet-vaguelette restoration in photon-limited imaging , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[17]  S. Mallat A wavelet tour of signal processing , 1998 .

[18]  Richard G. Baraniuk,et al.  Wavelet-based deconvolution for ill-conditioned systems , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[19]  Richard G. Baraniuk,et al.  Wavelet-based deconvolution using optimally regularized inversion for ill-conditioned systems , 1999, Optics & Photonics.

[20]  Aria Nosratinia,et al.  Wavelet-Based Image Coding: An Overview , 1999 .

[21]  Yi Wan,et al.  Bayesian multiscale approach to joint image restoration and edge detection , 1999, Optics & Photonics.

[22]  I. Johnstone WAVELET SHRINKAGE FOR CORRELATED DATA AND INVERSE PROBLEMS: ADAPTIVITY RESULTS , 1999 .

[23]  I. Johnstone,et al.  ASYMPTOTIC MINIMAXITY OF WAVELET ESTIMATORS WITH SAMPLED DATA , 1999 .

[24]  M. Unser Sampling-50 years after Shannon , 2000, Proceedings of the IEEE.

[25]  Josiane Zerubia,et al.  Estimation of adaptive parameters for satellite image deconvolution , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[26]  J. Zerubia,et al.  Adaptive Parameter Estimation for Satellite Image Deconvolution , 2000 .

[27]  Richard G. Baraniuk,et al.  A Hidden Markov Tree Model for the Complex Wavelet Transform , 2001 .

[28]  Nick G. Kingsbury,et al.  Bayesian image deconvolution and denoising using complex wavelets , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[29]  N. Kingsbury Complex Wavelets for Shift Invariant Analysis and Filtering of Signals , 2001 .

[30]  M. Gormish,et al.  Multiscale Sharpening and Smoothing in Besov Spaces with Applications to Image Enhancement , 2001 .

[31]  Mário A. T. Figueiredo,et al.  Image Restoration Using the EM Algorithm and Wavelet-Based Complexity Regularization , 2002 .

[32]  S. Mallat,et al.  Thresholding estimators for linear inverse problems and deconvolutions , 2003 .