Adaptive Filter Design Using Recurrent Cerebellar Model Articulation Controller

A novel adaptive filter is proposed using a recurrent cerebellar-model-articulation-controller (CMAC). The proposed locally recurrent globally feedforward recurrent CMAC (RCMAC) has favorable properties of small size, good generalization, rapid learning, and dynamic response, thus it is more suitable for high-speed signal processing. To provide fast training, an efficient parameter learning algorithm based on the normalized gradient descent method is presented, in which the learning rates are on-line adapted. Then the Lyapunov function is utilized to derive the conditions of the adaptive learning rates, so the stability of the filtering error can be guaranteed. To demonstrate the performance of the proposed adaptive RCMAC filter, it is applied to a nonlinear channel equalization system and an adaptive noise cancelation system. The advantages of the proposed filter over other adaptive filters are verified through simulations.

[1]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[2]  James S. Albus,et al.  New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC)1 , 1975 .

[3]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[4]  C.F.N. Cowan,et al.  Adaptive equalization of finite nonlinear channels using multilayer perceptron , 1990 .

[5]  Sheng Chen,et al.  Reconstruction of binary signals using an adaptive radial-basis-function equalizer , 1991, Signal Process..

[6]  Giovanni Soda,et al.  Local Feedback Multilayered Networks , 1992, Neural Computation.

[7]  Jenq-Neng Hwang,et al.  Coordinated training of noise removing networks , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Ah Chung Tsoi,et al.  Locally recurrent globally feedforward networks: a critical review of architectures , 1994, IEEE Trans. Neural Networks.

[9]  Li-Xin Wang,et al.  Adaptive fuzzy systems and control - design and stability analysis , 1994 .

[10]  Visakan Kadirkamanathan,et al.  Recursive nonlinear identification using multiple model algorithm , 1995, Proceedings of 1995 IEEE Workshop on Neural Networks for Signal Processing.

[11]  G. Horvath,et al.  Recurrent CMAC: a powerful neural network for system identification , 1996, Quality Measurement: The Indispensable Bridge between Theory and Reality (No Measurements? No Science! Joint Conference - 1996: IEEE Instrumentation and Measurement Technology Conference and IMEKO Tec.

[12]  Lin Chun-Shin,et al.  CMAC with General Basis Functions. , 1996, Neural networks : the official journal of the International Neural Network Society.

[13]  Chin-Teng Lin,et al.  An adaptive neural fuzzy filter and its applications , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Aníbal R. Figueiras-Vidal,et al.  Generalizing CMAC architecture and training , 1998, IEEE Trans. Neural Networks.

[15]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[16]  Shih-Lin Hung,et al.  High-order MS CMAC neural network , 2001, IEEE Trans. Neural Networks.

[17]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[18]  M.G. Simoes,et al.  Parametric CMAC networks: fundamentals and applications of a fast convergence neural structure , 2002, Conference Record of the 2002 IEEE Industry Applications Conference. 37th IAS Annual Meeting (Cat. No.02CH37344).

[19]  Narasimhan Sundararajan,et al.  Communication channel equalization using complex-valued minimal radial basis function neural networks , 2002, IEEE Trans. Neural Networks.

[20]  Chi K. Tse,et al.  A neural-network-based channel-equalization strategy for chaos-based communication systems , 2003 .

[21]  Noureddine Zerhouni,et al.  Recurrent radial basis function network for time-series prediction , 2003 .

[22]  Danilo P. Mandic,et al.  A generalized normalized gradient descent algorithm , 2004, IEEE Signal Processing Letters.

[23]  Cheng-Jian Lin,et al.  A self-organizing recurrent fuzzy CMAC model for dynamic system identification , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[24]  Marco A. Moreno-Armendáriz,et al.  Recurrent fuzzy CMAC in hierarchical form for dynamic system identification , 2007, 2007 American Control Conference.

[25]  Chih-Min Lin,et al.  Car-Following Control Using Recurrent Cerebellar Model Articulation Controller , 2007, IEEE Transactions on Vehicular Technology.

[26]  Chih-Min Lin,et al.  RCMAC Hybrid Control for MIMO Uncertain Nonlinear Systems Using Sliding-Mode Technology , 2007, IEEE Transactions on Neural Networks.