A new class of nonlinear filters-neural filters

A class of nonlinear filters based on threshold decomposition and neural networks is defined. It is shown that these neural filters include all filters defined either by continuous functions, such as linear finite impulse response (FIR) filters, or by Boolean functions, such as generalized stack filters. Adaptive least-mean-absolute-error and adaptive least-mean-square-error algorithms are derived for determining optimal neural filters. As special cases, adaptive generalized stack and adaptive generalized weighted order statistic filtering algorithms under both error criteria are derived. Experimental results in 1D and 2D signal processing are presented to compare the performances of the adaptive neural filters and other widely used filters. >

[1]  Moncef Gabbouj,et al.  Optimal stack filtering and the estimation and structural approaches to image processing , 1989, Sixth Multidimensional Signal Processing Workshop,.

[2]  Moncef Gabbouj,et al.  Minimum Mean Absolute Error Stack Filtering with Structural Constraints and Goals , 1990 .

[3]  Edward J. Coyle,et al.  Stack filters and the mean absolute error criterion , 1988, IEEE Trans. Acoust. Speech Signal Process..

[4]  Yrjö Neuvo,et al.  Adaptive weighted order statistic filters using back propagation algorithm , 1990, IEEE International Symposium on Circuits and Systems.

[5]  Bernard Widrow,et al.  Neural nets for adaptive filtering and adaptive pattern recognition , 1988, Computer.

[6]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[7]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[8]  Sung Ho Cho,et al.  Tracking analysis of the sign algorithm in nonstationary environments , 1990, IEEE Trans. Acoust. Speech Signal Process..

[9]  Sze Tsen Hu,et al.  Threshold Logic , 1966 .

[10]  T. Sellke,et al.  Adaptive stack filtering under the mean absolute error criterion , 1990 .

[11]  Edward J. Coyle,et al.  Threshold decomposition of multidimensional ranked order operations , 1985 .

[12]  M. Schetzen.  The Volterra and Wiener Theories of Nonlinear Systems , 1980 .

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  J. Fitch,et al.  Median filtering by threshold decomposition , 1984 .

[15]  Pao-Ta Yu,et al.  On the existence and design of the best stack filter based associative memory , 1990, IEEE International Symposium on Circuits and Systems.

[16]  Edward J. Coyle,et al.  Minimum mean absolute error estimation over the class of generalized stack filters , 1990, IEEE Trans. Acoust. Speech Signal Process..

[17]  Jaakko Astola,et al.  Adaptive multistage weighted order statistic filters based on the backpropagation algorithm , 1994, IEEE Trans. Signal Process..

[18]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[19]  Jaakko Astola,et al.  Digital Filters Based On Threshold Decomposition And Boolean Functions , 1989, Other Conferences.

[20]  Alex Waibel,et al.  Noise reduction using connectionist models , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[21]  Allen Gersho,et al.  Adaptive filtering with binary reinforcement , 1984, IEEE Trans. Inf. Theory.

[22]  Francesco Palmieri,et al.  Ll-filters-a new class of order statistic filters , 1989, IEEE Trans. Acoust. Speech Signal Process..

[23]  Peter D. Wendt.  Nonrecursive and recursive stack filters and their filtering behavior , 1990, IEEE Trans. Acoust. Speech Signal Process..

[24]  Jaakko Astola,et al.  Adaptive multistage weighted order-statistic filters for image restoration , 1991, Electronic Imaging.

[25]  Edward J. Coyle,et al.  Stack filters and neural networks , 1989, IEEE International Symposium on Circuits and Systems,.

[26]  Pao-Ta Yu,et al.  The classification and associative memory capability of stack filters , 1992, IEEE Trans. Signal Process..

[27]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[28]  Jaakko Astola,et al.  Optimal weighted order statistic filters under the mean absolute error criterion , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[29]  Edward J. Coyle,et al.  Stack filters , 1986, IEEE Trans. Acoust. Speech Signal Process..

[30]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[31]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[32]  Gonzalo R. Arce.  Microstatistics in signal decomposition and the optimal filtering problem , 1992, IEEE Trans. Signal Process..

[33]  Jaakko Astola,et al.  Analysis of the properties of median and weighted median filters using threshold logic and stack filter representation , 1991, IEEE Trans. Signal Process..