Robust Savitzky-Golay filters

Local polynomial approximation of data is an approach towards signal denoising. Savitzky-Golay (SG) filters are finite-impulse-response kernels, which convolve with the data to result in polynomial approximation for a chosen set of filter parameters. In the case of noise following Gaussian statistics, minimization of mean-squared error (MSE) between noisy signal and its polynomial approximation is optimum in the maximum-likelihood (ML) sense but the MSE criterion is not optimal for non-Gaussian noise conditions. In this paper, we robustify the SG filter for applications involving noise following a heavy-tailed distribution. The optimal filtering criterion is achieved by ℓ1-norm minimization of error through iteratively reweighted least-squares (IRLS) technique. It is interesting to note that at any stage of the iteration, we solve a weighted SG filter by minimizing ℓ2 norm but the process converges to ℓ1 minimized output. The results show consistent improvement over the standard SG filter performance.

[1]  Dr. M. G. Worster Methods of Mathematical Physics , 1947, Nature.

[2]  M. Bromba,et al.  Application hints for Savitzky-Golay digital smoothing filters , 1981 .

[3]  R. Schafer,et al.  What Is a Savitzky-Golay Filter? , 2022 .

[4]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[6]  Ronald W. Schafer,et al.  On the frequency-domain properties of Savitzky-Golay filters , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[7]  R. King,et al.  The analysis of hyperspectral data using Savitzky-Golay filtering-theoretical basis. 1 , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[8]  P. Schoenmakers,et al.  Automatic selection of optimal Savitzky-Golay smoothing. , 2006, Analytical chemistry.

[9]  Gary L. Wise,et al.  Robust detection in nominally Laplace noise , 1994, IEEE Trans. Commun..

[10]  Chandra Sekhar Seelamantula,et al.  On the Selection of Optimum Savitzky-Golay Filters , 2013, IEEE Transactions on Signal Processing.

[11]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[12]  Chandra Sekhar Seelamantula,et al.  Sure-optimal two-dimensional Savitzky-Golay filters for image denoising , 2013, 2013 IEEE International Conference on Image Processing.

[13]  Norman C. Beaulieu,et al.  ML Estimation of Signal Amplitude in Laplace Noise , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[14]  Michael Muma,et al.  Robust Estimation in Signal Processing: A Tutorial-Style Treatment of Fundamental Concepts , 2012, IEEE Signal Processing Magazine.

[15]  Ronald W. Schafer,et al.  What Is a Savitzky-Golay Filter? [Lecture Notes] , 2011, IEEE Signal Processing Magazine.

[16]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[17]  S. Patton Robust estimation of the acoustic attenuation parameter , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[18]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[19]  Berwin A. Turlach,et al.  On algorithms for solving least squares problems under an L1 penalty or an L1 constraint , 2005 .

[20]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[21]  David Middleton,et al.  Non-Gaussian Noise Models in Signal Processing for Telecommunications: New Methods and Results for Class A and Class B Noise Models , 1999, IEEE Trans. Inf. Theory.

[22]  Yuri I. Abramovich,et al.  Impulsive Noise Mitigation in Spatial and Temporal Domains for Surface-Wave Over-the-Horizon Radar , 1999 .

[23]  L. Mili,et al.  Electric Load Forecasting Based on Statistical Robust Methods , 2011, IEEE Transactions on Power Systems.