Hybrid Polynomial Filters for Gaussian and Non-Gaussian Noise Environments

Traditional polynomial filtering theory, based on linear combinations of polynomial terms, is able to approximate important classes of nonlinear systems. The linear combination of polynomial terms, however, yields poor performance in environments characterized by Gaussian and heavy tailed distributions. Weighted median and weighted myriad filters, in contrast, are well known for their outlier suppression and detail preservation properties. It is shown here that the weighted median and weighted myriad methodologies are naturally extended to the polynomial sample case, yielding hybrid filter structures that exploits the higher-order statistics of the observed samples while simultaneously being robust to outliers for both Gaussian and heavy-tailed distributions environments. Moreover, the introduced hybrid polynomial filter classes are well motivated by analysis of cross and square term statistics of Gaussian and heavy-tailed distributions. A presented asymptotic tail mass analysis shows that polynomial terms, both under Gaussian and heavy-tailed noise statistics, have heavier tails than the observed samples, indicating that robust combination methods should be utilized to avoid undue influence of outliers. Further analysis shows weighted median processing of polynomial terms for the Gaussian noise case, and weighted median and weighted myriad processing of cross and square terms, respectively, for the heavy-tailed noise case, are justified from a maximum likelihood perspective. Filters parameter optimization procedures are also presented. Finally, the effectiveness of hybrid filters is demonstrated through simulations that include temporal, spectrum, and bispectrum analysis

[1]  Jaakko Astola,et al.  Analysis of the properties of median and weighted median filters using threshold logic and stack filter representation , 1991, IEEE Trans. Signal Process..

[2]  Li Tan,et al.  Adaptive Volterra filters for active control of nonlinear noise processes , 2001, IEEE Trans. Signal Process..

[3]  Giovanni L. Sicuranza,et al.  Theory and realization of M-D nonlinear digital filters , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Kenneth E. Barner,et al.  Nonlinear Signal and Image Processing: Theory, Methods, and Applications , 2003 .

[5]  Rudolf Rabenstein,et al.  Adaptive Volterra filters for nonlinear acoustic echo cancellation , 1999, NSIP.

[6]  Gonzalo R. Arce,et al.  A general weighted median filter structure admitting negative weights , 1998, IEEE Trans. Signal Process..

[7]  V. J. Mathews,et al.  Polynomial Signal Processing , 2000 .

[8]  M. B. Priestley,et al.  Non-linear and non-stationary time series analysis , 1990 .

[9]  D. Falconer Adaptive equalization of channel nonlinearities in QAM data transmission systems , 1978, The Bell System Technical Journal.

[10]  Elias Masry,et al.  Alpha-stable signals and adaptive filtering , 2000, IEEE Trans. Signal Process..

[11]  C. L. Nikias,et al.  Higher-order spectra analysis : a nonlinear signal processing framework , 1993 .

[12]  Katta G. Murty,et al.  Nonlinear Programming Theory and Algorithms , 2007, Technometrics.

[13]  David G. Messerschmitt,et al.  Nonlinear Echo Cancellation of Data Signals , 1982, IEEE Trans. Commun..

[14]  Gonzalo R. Arce,et al.  Median power and median correlation theory , 2002, IEEE Trans. Signal Process..

[15]  Giovanni Ramponi,et al.  Adaptive nonlinear prediction of TV image sequences , 1989 .

[16]  Giovanni L. Sicuranza,et al.  Simplified volterra filters for acoustic echo cancellation in GSM receivers , 2000, 2000 10th European Signal Processing Conference.

[17]  Jaakko Astola,et al.  On the robustness of the class of stack filters , 2002, IEEE Trans. Signal Process..

[18]  R. de Figueiredo The Volterra and Wiener theories of nonlinear systems , 1982, Proceedings of the IEEE.

[19]  Gonzalo R. Arce,et al.  Robust frequency-selective filtering using weighted myriad filters admitting real-valued weights , 2001, IEEE Trans. Signal Process..

[20]  Sergio Benedetto,et al.  Nonlinear Equalization of Digital Satellite Channels , 1982, IEEE J. Sel. Areas Commun..

[21]  Sergio Benedetto,et al.  Digital Transmission Theory , 1987 .

[22]  Gonzalo R. Arce,et al.  Nonlinear Signal Processing - A Statistical Approach , 2004 .

[23]  G. Ramponi Edge extraction by a class of second-order nonlinear filters , 1986 .

[24]  Edward J. Powers,et al.  Quadratic system identification using higher order spectra of i.i.d. signals , 1994, IEEE Trans. Signal Process..

[25]  Sung-Jea Ko,et al.  Design of linear combination of weighted medians , 2001, IEEE Trans. Signal Process..

[26]  Steven C. Bass,et al.  Adaptive noise cancellation for a class of nonlinear, dynamic reference channels , 1985 .

[27]  Giovanni Ramponi,et al.  Quadratic digital filters for image processing , 1988, IEEE Trans. Acoust. Speech Signal Process..

[28]  Ioannis Pitas,et al.  Nonlinear Digital Filters - Principles and Applications , 1990, The Springer International Series in Engineering and Computer Science.

[29]  A. Erdélyi,et al.  Higher Transcendental Functions , 1954 .

[30]  Chrysostomos L. Nikias,et al.  Efficient implementations of quadratic digital filters , 1986, IEEE Trans. Acoust. Speech Signal Process..

[31]  Rudolf Rabenstein,et al.  Nonlinear acoustic echo cancellation with 2nd order adaptive Volterra filters , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[32]  Gonzalo R. Arce,et al.  Optimality of the myriad filter in practical impulsive-noise environments , 2001, IEEE Trans. Signal Process..

[33]  Kenneth E. Barner,et al.  RED gateway congestion control using median queue size estimates , 2003, IEEE Trans. Signal Process..

[34]  Ezio Biglieri,et al.  Analysis and compensation of nonlinearities in digital transmission systems , 1988, IEEE J. Sel. Areas Commun..

[35]  S. Gazor,et al.  Speech probability distribution , 2003, IEEE Signal Processing Letters.

[36]  Larry J. Greenstein,et al.  Performance Analysis of Digital Radio Links with Nonlinear Transmit Amplifiers , 1987, IEEE J. Sel. Areas Commun..

[37]  Gonzalo R. Arce,et al.  Adaptive weighted myriad filter algorithms for robust signal processing in α-stable noise environments , 1998, IEEE Trans. Signal Process..

[38]  Jonas August,et al.  Volterra Filtering of Noisy Images of Curves , 2002, ECCV.

[39]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[40]  Kenneth E. Barner,et al.  Polynomial weighted median filtering , 2005, IEEE Transactions on Signal Processing.

[41]  Nicholas Kalouptsidis,et al.  Second-order Volterra system identification , 2000, IEEE Trans. Signal Process..

[42]  I. Shmulevich,et al.  Spectral design of weighted median filters admitting negative weights , 2001, IEEE Signal Processing Letters.

[43]  W. Martin Snelgrove,et al.  Adaptive linearization of a loudspeaker , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[44]  Edward J. Powers,et al.  A digital method of modeling quadratically nonlinear systems with a general random input , 1988, IEEE Trans. Acoust. Speech Signal Process..

[45]  Nicholas Kalouptsidis,et al.  Third order Volterra system identification , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[46]  D. R. K. Brownrigg,et al.  The weighted median filter , 1984, CACM.

[47]  Ezio Biglieri,et al.  Theory of volterra processors and some applications , 1982, ICASSP.

[48]  B. Saleh Optical Bilinear Transformations: General Properties , 1979 .

[49]  J. C. Eilbeck Table errata: Higher transcendental functions. Vol. I, II (McGraw-Hill, New York, 1953) by A. Erdélyi, W. Magnus, F. Oberhettinger and F. G. Tricomi , 1971 .

[50]  Moncef Gabbouj,et al.  Weighted median filters: a tutorial , 1996 .

[51]  Sanjit K. Mitra,et al.  A general framework for quadratic Volterra filters for edge enhancement , 1996, IEEE Trans. Image Process..

[52]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .