Recurrent neuro-fuzzy hybrid-learning approach to accurate system modeling

A recurrent neuro-fuzzy approach with RO-LSE hybrid learning algorithm to the problem of system modeling is proposed in the paper. The proposed recurrent neuro-fuzzy system possesses six layers of neural network to perform the fuzzy inference. The recurrent structure is formed using lagged membership-grade signals as internal feedbacks to the layer of membership functions of fuzzy sets, and it is expected having great potential to trace the temporal change of signals. Fuzzy sets with time-varying kernels have excellent property, with that the input-output mapping of the neuro-fuzzy system is no longer fixed but time varying. In this study, a new parameter learning approach is proposed for NFS with good learning convergence, in which the hybrid RO-LSE learning algorithm is utilized for the update of parameters. The well-known random optimization (RO) method is used to update the parameters of the premise parts of the proposed system, and the method of least square estimation (LSE) to update those of the consequent parts. The hybrid algorithm is found useful, and it has shown fast convergence of parameter learning for the proposed system. Three examples are used to demonstrate the brilliancy of the proposed approach. Excellent performance of the proposed approach in modeling accuracy and learning convergence is observed.

[1]  Min Han,et al.  Prediction of chaotic time series based on the recurrent predictor neural network , 2004, IEEE Transactions on Signal Processing.

[2]  Haralambos Sarimveis,et al.  A hierarchical fuzzy-clustering approach to fuzzy modeling , 2005, Fuzzy Sets Syst..

[3]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[4]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[5]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[6]  Shie-Jue Lee,et al.  A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning , 2003, IEEE Trans. Fuzzy Syst..

[7]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[8]  Chih-Min Lin,et al.  Supervisory recurrent fuzzy neural network control of wing rock for slender delta wings , 2004, IEEE Trans. Fuzzy Syst..

[9]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Mu-Chun Su,et al.  Application of neural networks incorporated with real-valued genetic algorithms in knowledge acquisition , 2000, Fuzzy Sets Syst..

[11]  Satish Kumar,et al.  Subsethood-product fuzzy neural inference system (SuPFuNIS) , 2002, IEEE Trans. Neural Networks.

[12]  Chunshien Li,et al.  Self-organizing neuro-fuzzy system for control of unknown plants , 2003, IEEE Trans. Fuzzy Syst..

[13]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[14]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..

[15]  Ching-Chang Wong,et al.  A GA-based method for constructing fuzzy systems directly from numerical data , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Cheng-Jian Lin,et al.  Prediction and identification using wavelet-based recurrent fuzzy neural networks , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[17]  Richard D. Braatz,et al.  On the "Identification and control of dynamical systems using neural networks" , 1997, IEEE Trans. Neural Networks.

[18]  Cheng-Jian Lin,et al.  Identification and prediction using recurrent compensatory neuro-fuzzy systems , 2005, Fuzzy Sets Syst..

[19]  Bart Kosko,et al.  Fuzzy Engineering , 1996 .

[20]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[21]  Alan V. Oppenheim,et al.  Synchronization of Lorenz-based chaotic circuits with applications to communications , 1993 .

[22]  Kourosh Danai,et al.  Model-based recurrent neural network for modeling nonlinear dynamic systems , 1999, Proceedings of the 1999 IEEE International Conference on Control Applications (Cat. No.99CH36328).

[23]  Emil Levi,et al.  Identification of complex systems based on neural and Takagi-Sugeno fuzzy model , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Paris A. Mastorocostas,et al.  A recurrent fuzzy-neural model for dynamic system identification , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..