Multiscale Methods for Denoising and Compression

Multiscale methods for denoising and compression are discussed in this chapter. Denoising of an individual signal is usually performed by various filtering methods based on assumptions about the nature of the errors and the smoothness of the underlying signal. These methods are the primary emphasis of this chapter. For denoising multivariate data, fundamental or empirical models relating the variables may be used. Denoising with fundamental process models is referred to as “data reconciliation,” and requires solution of a constrained optimization problem. If an accurate fundamental model is not available, multivariate data may be denoised by empirical modeling methods, such as principal component analysis. Because accurate process models relating the hundreds of measured variables are not easily obtained, the simplest and most widely used denoising methods do not rely on a fundamental or empirical process model. The chapter reviews multiscale wavelet-based representation of data and its advantages. Then, various filtering and compression techniques are described, which include linear filtering such as finite impulse response (FIR) and infinite impulse response (IIR) filtering, and nonlinear filtering and compression such as median hybrid filters (FMH) filtering and multiscale filtering. Finally, an online multiscale filtering technique is presented.

[1]  J. C. Hale,et al.  Historical data recording for process computers , 1981 .

[2]  G. Wise,et al.  A theoretical analysis of the properties of median filters , 1981 .

[3]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[4]  M. T. Tham,et al.  Succeed at on-line validation and reconstruction of data , 1994 .

[5]  George Stephanopoulos,et al.  Compression of chemical process data by functional approximation and feature extraction , 1996 .

[6]  Robert D. Strum,et al.  First principles of discrete systems and digital signal processing , 1988 .

[7]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[8]  David L. Donoho,et al.  Denoising and robust nonlinear wavelet analysis , 1994, Defense, Security, and Sensing.

[9]  Hong-Ye Gao,et al.  Applied wavelet analysis with S-plus , 1996 .

[10]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  I. Johnstone,et al.  Ideal denoising in an orthonormal basis chosen from a library of bases , 1994 .

[12]  I. Daubechies,et al.  Wavelets on the Interval and Fast Wavelet Transforms , 1993 .

[14]  G. Nason Wavelet Shrinkage using Cross-validation , 1996 .

[15]  Ajit C. Tamhane,et al.  Process trending with piecewise linear smoothing , 1995 .

[16]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[17]  I. Johnstone,et al.  Wavelet Shrinkage: Asymptopia? , 1995 .

[18]  Yrjö Neuvo,et al.  FIR-median hybrid filters with predictive FIR substructures , 1988, IEEE Trans. Acoust. Speech Signal Process..

[19]  Michael H. Neumann,et al.  Wavelet Thresholding: Beyond the Gaussian I.I.D. Situation , 1995 .

[20]  Yrjö Neuvo,et al.  FIR-median hybrid filters , 1987, IEEE Trans. Acoust. Speech Signal Process..

[21]  B. Bakshi,et al.  On-line multiscale filtering of random and gross errors without process models , 1999 .