Parameter identification of TSK neuro-fuzzy models

Abstract In the framework of the TSK neuro-fuzzy model a combination of the two well-known identification methods are employed for parameter estimation of the neuro-fuzzy inference system, namely the series–parallel and the parallel configurations. The presented paper proposes two new possible configurations for identifying the parameters of the TSK neuro-fuzzy model using the combinations of these two existing configurations. One of the proposed configurations constitutes the series–parallel configuration to the premise part and the parallel configuration to the consequent part of the neuro-fuzzy model, termed as PS-P configuration. The second one is composed of the series–parallel configuration to the consequent part and the parallel configuration to the premise part of the neuro-fuzzy model, termed as CS-P configuration. The presented work mainly deals with a comparative study of the proposed configurations and the existing configurations in the context of parameter identification of the TSK neuro-fuzzy model on three different benchmark examples. Moreover, it investigates upper bound of the learning rates, using the Lyapunov stability theorem, to assure the stability and the convergence of the model learning process. Implementation of the modified mountain clustering (MMC) and the cluster validity function yields initial models. To restrict the upper bound during the learning process it also presents a two-phase adaptive learning rate.

[1]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[2]  Xiao-Jun Zeng,et al.  Approximation theory of fuzzy systems-SISO case , 1994, IEEE Trans. Fuzzy Syst..

[3]  Ronald J. Williams,et al.  A Learning Algorithm for Continually Running Fully Recurrent Neural Networks , 1989, Neural Computation.

[4]  A. Tesi,et al.  New conditions for global stability of neural networks with application to linear and quadratic programming problems , 1995 .

[5]  Xiaoou Li,et al.  Fuzzy identification using fuzzy neural networks with stable learning algorithms , 2004, IEEE Transactions on Fuzzy Systems.

[6]  PAUL J. WERBOS,et al.  Generalization of backpropagation with application to a recurrent gas market model , 1988, Neural Networks.

[7]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[8]  M. Forti.  On Global Asymptotic Stability of a Class of Nonlinear Systems Arising in Neural Network Theory , 1994 .

[9]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[10]  Madhusudan Singh,et al.  New fuzzy wavelet neural networks for system identification and control , 2005, Appl. Soft Comput..

[11]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Xiao-Jun Zeng,et al.  Approximation theory of fuzzy systems-MIMO case , 1995, IEEE Trans. Fuzzy Syst..

[13]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[14]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Xiaofeng Liao,et al.  Robust Stability and Robust Periodicity of Delayed Recurrent Neural Networks With Noise Disturbance , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[16]  Ramesh C. Jain,et al.  A robust backpropagation learning algorithm for function approximation , 1994, IEEE Trans. Neural Networks.

[17]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[18]  Xiaoou Li,et al.  Some new results on system identification with dynamic neural networks , 2001, IEEE Trans. Neural Networks.

[19]  M. Sugeno,et al.  Structure identification of fuzzy model , 1988 .

[20]  Zhang Yi,et al.  Output convergence analysis for a class of delayed recurrent neural networks with time-varying inputs , 2006, IEEE Trans. Syst. Man Cybern. Part B.

[21]  S Z Qin,et al.  Comparison of four neural net learning methods for dynamic system identification , 1992, IEEE Trans. Neural Networks.

[22]  Jianhong Wu,et al.  A new method of Lyapunov functionals for delayed cellular neural networks , 2004, IEEE Trans. Circuits Syst. I Regul. Pap..

[23]  George E. P. Box,et al.  Time Series Analysis: Box/Time Series Analysis , 2008 .

[24]  Kwong-Sak Leung,et al.  Convergence analysis of cellular neural networks with unbounded delay , 2001 .

[25]  F. Palis,et al.  Modeling and control of non-linear systems using soft computing techniques , 2007, Appl. Soft Comput..

[26]  Mohammad Fazle Azeem,et al.  Parameter Estimation of Neuro-Fuzzy Model by Parallel and Series-Parallel Identification Configurations , 2007, 2007 IEEE International Fuzzy Systems Conference.

[27]  Xiaoou Li,et al.  Some stability properties of dynamic neural networks , 2001 .

[28]  Jinde Cao,et al.  Novel Stability Criteria for Delayed Cellular Neural Networks , 2003, Int. J. Neural Syst..

[29]  J.B. Theocharis,et al.  Long-term wind speed and power forecasting using local recurrent neural network models , 2006, IEEE Transactions on Energy Conversion.

[30]  Jinde Cao,et al.  Global asymptotic stability of a general class of recurrent neural networks with time-varying delays , 2003 .

[31]  Liang Jin,et al.  Stable dynamic backpropagation learning in recurrent neural networks , 1999, IEEE Trans. Neural Networks.

[32]  A. Bernieri,et al.  A neural network approach for identification and fault diagnosis on dynamic systems , 1993 .

[33]  Xue-Bin Liang,et al.  Global exponential stability of neural networks with globally Lipschitz continuous activations and its application to linear variational inequality problem , 2001, IEEE Trans. Neural Networks.

[34]  Madasu Hanmandlu,et al.  Structure identification of generalized adaptive neuro-fuzzy inference systems , 2003, IEEE Trans. Fuzzy Syst..

[35]  Mohammad Fazle Azeem,et al.  Fuzzy modeling of fluidized catalytic cracking unit , 2007, Appl. Soft Comput..

[36]  Shixin Cheng,et al.  Dynamic learning rate optimization of the backpropagation algorithm , 1995, IEEE Trans. Neural Networks.

[37]  Chi-Hsu Wang,et al.  Function approximation using fuzzy neural networks with robust learning algorithm , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[39]  Jin Bae Park,et al.  Generalized predictive control based on self-recurrent wavelet neural network for stable path tracking of mobile robots: adaptive learning rates approach , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[40]  S. Chiu.  Method and software for extracting fuzzy classification rules by subtractive clustering , 1996, Proceedings of North American Fuzzy Information Processing.

[41]  Fernando Morgado Dias,et al.  Artificial neural networks and neuro-fuzzy systems for modelling and controlling real systems: a comparative study , 2004, Eng. Appl. Artif. Intell..

[42]  Jun Wang,et al.  Global output convergence of a class of continuous-time recurrent neural networks with time-varying thresholds , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[43]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[44]  Ioannis B. Theocharis,et al.  A GA-based fuzzy modeling approach for generating TSK models , 2002, Fuzzy Sets Syst..

[45]  Ching-Hung Lee,et al.  Identification and control of dynamic systems using recurrent fuzzy neural networks , 2000, IEEE Trans. Fuzzy Syst..