An adaptive neural fuzzy filter and its applications

A new kind of nonlinear adaptive filter, the adaptive neural fuzzy filter (ANFF), based upon a neural network's learning ability and fuzzy if-then rule structure, is proposed in this paper. The ANFF is inherently a feedforward multilayered connectionist network which can learn by itself according to numerical training data or expert knowledge represented by fuzzy if-then rules. The adaptation here includes the construction of fuzzy if-then rules (structure learning), and the tuning of the free parameters of membership functions (parameter learning). In the structure learning phase, fuzzy rules are found based on the matching of input-output clusters. In the parameter learning phase, a backpropagation-like adaptation algorithm is developed to minimize the output error. There are no hidden nodes (i.e., no membership functions and fuzzy rules) initially, and both the structure learning and parameter learning are performed concurrently as the adaptation proceeds. However, if some linguistic information about the design of the filter is available, such knowledge can be put into the ANFF to form an initial structure with hidden nodes. Two major advantages of the ANFF can thus be seen: 1) a priori knowledge can be incorporated into the ANFF which makes the fusion of numerical data and linguistic information in the filter possible; and 2) no predetermination, like the number of hidden nodes, must be given, since the ANFF can find its optimal structure and parameters automatically.

[1]  Jude Shavlik,et al.  Refinement ofApproximate Domain Theories by Knowledge-Based Neural Networks , 1990, AAAI.

[2]  Jaakko Astola,et al.  A new class of nonlinear filters-neural filters , 1993, IEEE Trans. Signal Process..

[3]  Michael J. Coker,et al.  A nonlinear adaptive noise canceller , 1980, ICASSP.

[4]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[5]  Alex Waibel,et al.  Noise reduction using connectionist models , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[6]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[7]  Sheng Chen,et al.  Reconstruction of binary signals using an adaptive radial-basis-function equalizer , 1991, Signal Process..

[8]  Edward J. Coyle,et al.  Minimum mean absolute error estimation over the class of generalized stack filters , 1990, IEEE Trans. Acoust. Speech Signal Process..

[9]  Q. Yang,et al.  Building expert systems by a modified perceptron network with rule-transfer algorithms , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[10]  Susan I. Hruska,et al.  Back-propagation learning in expert networks , 1992, IEEE Trans. Neural Networks.

[11]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[12]  Sergio Benedetto,et al.  Nonlinear Equalization of Digital Satellite Channels , 1982, IEEE J. Sel. Areas Commun..

[13]  Maurice Bellanger,et al.  Adaptive digital filters and signal analysis , 1987 .

[14]  Ioannis Pitas,et al.  Nonlinear Digital Filters - Principles and Applications , 1990, The Springer International Series in Engineering and Computer Science.

[15]  Steven C. Bass,et al.  Adaptive noise cancellation for a class of nonlinear, dynamic reference channels , 1985 .

[16]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[17]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[18]  H.B.D. Sorensen,et al.  A cepstral noise reduction multi-layer neural network , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[19]  Yoshiki Uchikawa,et al.  On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm , 1992, IEEE Trans. Neural Networks.

[20]  David G. Messerschmitt,et al.  Nonlinear Echo Cancellation of Data Signals , 1982, IEEE Trans. Commun..

[21]  Bart Kosko,et al.  Fuzzy Systems as Universal Approximators , 1994, IEEE Trans. Computers.

[22]  Jerry M. Mendel,et al.  Fuzzy adaptive filters, with application to nonlinear channel equalization , 1993, IEEE Trans. Fuzzy Syst..

[23]  D. Falconer Adaptive equalization of channel nonlinearities in QAM data transmission systems , 1978, The Bell System Technical Journal.

[24]  Bart Kosko,et al.  Neural networks and fuzzy systems , 1998 .

[25]  Jerry M. Mendel,et al.  Back-propagation fuzzy system as nonlinear dynamic system identifiers , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[26]  C.F.N. Cowan,et al.  The application of nonlinear structures to the reconstruction of binary signals , 1991, IEEE Trans. Signal Process..

[27]  Fuzzy Logic in Control Systems : Fuzzy Logic , 2022 .

[28]  Bernard Widrow,et al.  Neural nets for adaptive filtering and adaptive pattern recognition , 1988, Computer.

[29]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[30]  James Ting-Ho Lo,et al.  Synthetic approach to optimal filtering , 1994, IEEE Trans. Neural Networks.

[31]  S. A. Billings,et al.  Performance monitoring in nonlinear adaptive noise cancellation , 1990 .

[32]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[33]  Steve A. Billings,et al.  Performance monitoring in non-linear adaptive noise cancellation , 1992 .

[34]  Jenq-Neng Hwang,et al.  Coordinated training of noise removing networks , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Chuen-Chien Lee FUZZY LOGIC CONTROL SYSTEMS: FUZZY LOGIC CONTROLLER - PART I , 1990 .

[36]  Hisao Ishibuchi,et al.  Neural networks that learn from fuzzy if-then rules , 1993, IEEE Trans. Fuzzy Syst..

[37]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[38]  T. Sellke,et al.  Adaptive stack filtering under the mean absolute error criterion , 1990 .

[39]  Irving S. Reed,et al.  The use of neural nets to combine equalization with decoding for severe intersymbol interference channels , 1994, IEEE Trans. Neural Networks.

[40]  S. Theodoridis,et al.  Nonlinear channel equalization using clustering techniques , 1992, [Conference Record] SUPERCOMM/ICC '92 Discovering a New World of Communications.