Nonlinear system identification using Takagi-Sugeno type neuro-fuzzy model

Neuro-fuzzy (NF) modeling can be regarded as a gray-box technique on the boundary between neural networks and qualitative fuzzy models. The main motivation for this investigation is to develop an identification procedure for nonlinear systems and processes without having their complete information. The main problem in developing the Takagi-Sugeno (TS) type of neuro-fuzzy models is to identify the number of membership functions partitioning each input variable or the number of rules. Moreover, the neuro-fuzzy model of particular interest of type TS also has problem of poor initialization. In this paper, an algorithm for neuro-fuzzy modeling of nonlinear system identification is given, with an emphasis on the trade-off between accuracy and interpretability. The proposed algorithm not only solves the problem of poor initialization but also automatically identifies the optimal structure of the model and still gives the more accurate results in comparison to the standard neuro-fuzzy models. A two-step procedure of Takagi-Sugeno type neuro-fuzzy model is proposed here for nonlinear system modeling. In first step, a method of generation of optimal rule base is proposed and in the next step, based on the generated rule base, the structure of the neuro-fuzzy network is decided and thereafter, the constructed NF model is trained by improved Levenberg-Marquardt algorithm (LIMA). The proposed scheme not only eliminates the usual "trial-and-error" mechanism of structure identification but also accelerates the learning process by good initialization of fuzzy membership functions and rules consequents. The proposed method is tested on various benchmark problems. The corresponding results show that a good modeling capability is achieved without employing any complicated optimization procedure for structure identification of neuro-fuzzy model.

[1]  Robert Babuska,et al.  Efficient training algorithm for Takagi-Sugeno type neuro-fuzzy network , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[2]  Magne Setnes,et al.  GA-fuzzy modeling and classification: complexity and performance , 2000, IEEE Trans. Fuzzy Syst..

[3]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Robert Babuska,et al.  Fuzzy Modeling for Control , 1998 .

[5]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[6]  Yoshiki Uchikawa,et al.  On fuzzy modeling using fuzzy neural networks with the back-propagation algorithm , 1992, IEEE Trans. Neural Networks.

[7]  P. C. Panchariya,et al.  Simple Fuzzy Modeling Scheme for Compact TS Fuzzy Model Using a Real-Coded Genetic Algorithm , 2003, Indian International Conference on Artificial Intelligence.

[8]  John Yen,et al.  Simplifying fuzzy rule-based models using orthogonal transformation methods , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Dobrivoje Popovic,et al.  Nonlinear combination of forecasts using artificial neural network, fuzzy logic and neuro-fuzzy approaches , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[11]  Harpreet Singh,et al.  Generating optimal adaptive fuzzy-neural models of dynamical systems with applications to control , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[12]  Robert Babuska,et al.  Neuro-fuzzy methods for nonlinear system identification , 2003, Annu. Rev. Control..

[13]  Magne Setnes,et al.  Compact and transparent fuzzy models and classifiers through iterative complexity reduction , 2001, IEEE Trans. Fuzzy Syst..

[14]  Chin-Teng Lin,et al.  Neural-Network-Based Fuzzy Logic Control and Decision System , 1991, IEEE Trans. Computers.

[15]  P. C. Panchariya,et al.  Data Driven Simple Fuzzy Rule Generation Algorithm for Fuzzy Modeling and Identification , 2003, Indian International Conference on Artificial Intelligence.

[16]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..

[17]  T.,et al.  Training Feedforward Networks with the Marquardt Algorithm , 2004 .

[18]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Walter Anheier,et al.  Backpropagation based training algorithm for Takagi-Sugeno type MIMO neuro-fuzzy network to forecast electrical load time series , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[20]  Dobrivoje Popovic,et al.  Structural Optimization of Neural Networks for Systems Modelling , 1997 .

[21]  Hamid R. Berenji,et al.  Learning and tuning fuzzy logic controllers through reinforcements , 1992, IEEE Trans. Neural Networks.

[22]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[23]  John Yen,et al.  Application of statistical information criteria for optimal fuzzy model construction , 1998, IEEE Trans. Fuzzy Syst..

[24]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..