Prediction and identification using wavelet-based recurrent fuzzy neural networks

This paper presents a wavelet-based recurrent fuzzy neural network (WRFNN) for prediction and identification of nonlinear dynamic systems. The proposed WRFNN model combines the traditional Takagi-Sugeno-Kang (TSK) fuzzy model and the wavelet neural networks (WNN). This paper adopts the nonorthogonal and compactly supported functions as wavelet neural network bases. Temporal relations embedded in the network are caused by adding some feedback connections representing the memory units into the second layer of the feedforward wavelet-based fuzzy neural networks (WFNN). An online learning algorithm, which consists of structure learning and parameter learning, is also presented. The structure learning depends on the degree measure to obtain the number of fuzzy rules and wavelet functions. Meanwhile, the parameter learning is based on the gradient descent method for adjusting the shape of the membership function and the connection weights of WNN. Finally, computer simulations have demonstrated that the proposed WRFNN model requires fewer adjustable parameters and obtains a smaller rms error than other methods.

[1]  Chia-Feng Juang,et al.  A recurrent self-organizing neural fuzzy inference network , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[2]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[3]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[4]  Jude W. Shavlik,et al.  Extracting Refined Rules from Knowledge-Based Neural Networks , 1993, Machine Learning.

[5]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[6]  Cheng-Jian Lin,et al.  A wavelet-based neuro-fuzzy system and its applications , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[7]  Stephen A. Billings,et al.  Recurrent radial basis function networks for adaptive noise cancellation , 1995, Neural Networks.

[8]  George C. Mouzouris,et al.  Dynamic non-Singleton fuzzy logic systems for nonlinear modeling , 1997, IEEE Trans. Fuzzy Syst..

[9]  Ying Chen,et al.  Identifying chaotic systems via a Wiener-type cascade model , 1997 .

[10]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[11]  Chih-Hong Lin,et al.  Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive , 2001, IEEE Trans. Fuzzy Syst..

[12]  M. Gupta,et al.  Approximation of discrete-time state-space trajectories using dynamic recurrent neural networks , 1995, IEEE Trans. Autom. Control..

[13]  C. S. George Lee,et al.  Neural fuzzy systems: a neuro-fuzzy synergism to intelligent systems , 1996 .

[14]  Shun-Feng Su,et al.  On the dynamical modeling with neural fuzzy networks , 2002, IEEE Trans. Neural Networks.

[15]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[16]  Uk-Youl Huh,et al.  Fuzzy model based predictive control , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[17]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[18]  W. Rudin.  Principles of mathematical analysis , 1964 .

[19]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[20]  Chin-Teng Lin,et al.  An ART-based fuzzy adaptive learning control network , 1997, IEEE Trans. Fuzzy Syst..

[21]  Alberto Del Bimbo,et al.  Block-structured recurrent neural networks , 1995, Neural Networks.

[22]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[23]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[24]  Eiji Mizutani,et al.  Coactive neural fuzzy modeling , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[25]  Daniel W. C. Ho,et al.  Fuzzy wavelet networks for function learning , 2001, IEEE Trans. Fuzzy Syst..

[26]  Takeshi Yamakawa,et al.  Wavelet neural networks employing over-complete number of compactly supported non-orthogonal wavelets and their applications , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[27]  Derek A. Linkens,et al.  Learning control using fuzzified self-organizing radial basis function network , 1993, IEEE Trans. Fuzzy Syst..

[28]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Jie Zhang,et al.  Recurrent neuro-fuzzy networks for nonlinear process modeling , 1999, IEEE Trans. Neural Networks.

[30]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[31]  Sheng-Fu Liang,et al.  A class of physical modeling recurrent networks for analysis/synthesis of plucked string instruments , 2002, IEEE Trans. Neural Networks.

[32]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[33]  Hideyuki Takagi,et al.  Neural networks designed on approximate reasoning architecture and their applications , 1992, IEEE Trans. Neural Networks.