Data-driven evolving fuzzy systems using eTS and FLEXFIS: comparative analysis

In this paper, two approaches for the incremental data-driven learning of one of the most effective fuzzy model, namely of so-called Takagi–Sugeno type, are compared. The algorithms that realize these approaches include not only adaptation of linear parameters in fuzzy systems appearing in the rule consequents, but also incremental learning and evolution of premise parameters appearing in the membership functions (i.e. fuzzy sets) in sample mode together with a rule learning strategy. In this sense the proposed methods are applicable for fast model training tasks in various industrial processes, whenever there is a demand of online system identification in order to apply models representing nonlinear system behaviors to system monitoring, online fault detection or open-loop control. An evaluation of the incremental learning algorithms are included at the end of the paper, where a comparison between conventional batch modelling methods for fuzzy systems and the incremental learning methods demonstrated in this paper is made with respect to model qualities and computation time. This evaluation is based on high dimensional data coming from an industrial measuring process as well as from a known source on the Internet, which underlines the usage of the new method for fast online identification tasks.

[1]  Joos Vandewalle,et al.  Constructing fuzzy models with linguistic integrity from numerical data-AFRELI algorithm , 2000, IEEE Trans. Fuzzy Syst..

[2]  Klaus Nordhausen,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman , 2009 .

[3]  George C. Mouzouris,et al.  A Singular-Value-QR Decomposition Based Method for Training Fuzzy Logic Systems in Uncertain Environments , 1997, J. Intell. Fuzzy Syst..

[4]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[5]  Dimitar Filev,et al.  Generation of Fuzzy Rules by Mountain Clustering , 1994, J. Intell. Fuzzy Syst..

[6]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[7]  Gregg D. Wilensky,et al.  Neural Network Studies , 1993 .

[8]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[10]  Weihua Li,et al.  Recursive PCA for adaptive process monitoring , 1999 .

[11]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[12]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[13]  Igor V. Tetko,et al.  Neural network studies, 1. Comparison of overfitting and overtraining , 1995, J. Chem. Inf. Comput. Sci..

[14]  L X Wang,et al.  Fuzzy basis functions, universal approximation, and orthogonal least-squares learning , 1992, IEEE Trans. Neural Networks.

[15]  Alexey Tsymbal,et al.  The problem of concept drift: definitions and related work , 2004 .

[16]  Plamen P. Angelov,et al.  Advances in classification of EEG signals via evolving fuzzy classifiers and dependant multiple HMMs , 2006, Comput. Biol. Medicine.

[17]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[18]  Magne Setnes.  Simplification and reduction of fuzzy rules , 2003 .

[19]  Edwin Lughofer,et al.  An approach to model-based fault detection in industrial measurement systems with application to engine test benches , 2006 .

[20]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Dimitar Filev,et al.  Flexible models with evolving structure , 2004 .

[22]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[23]  John Yen,et al.  Simplifying fuzzy rule-based models using orthogonal transformation methods , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[24]  Eyke Hüllermeier,et al.  Improving the interpretability of data-driven evolving fuzzy systems , 2005, EUSFLAT Conf..

[25]  Plamen P. Angelov,et al.  On-line identification of MIMO evolving Takagi- Sugeno fuzzy models , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[26]  Plamen Angelov,et al.  Evolving Rule-Based Models: A Tool For Design Of Flexible Adaptive Systems , 2002 .

[27]  P. Angelov,et al.  Evolving rule-based models: A tool for intelligent adaptation , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[28]  Edwin Lughofer,et al.  FLEXFIS: A Variant for Incremental Learning of Takagi-Sugeno Fuzzy Systems , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[29]  Ronald R. Yager,et al.  Learning of Fuzzy Rules by Mountain Clustering , 1992 .

[30]  Shai Ben-David,et al.  Detecting Change in Data Streams , 2004, VLDB.

[31]  Mario Drobics,et al.  Regularized numerical optimization of fuzzy rule bases , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[32]  Ulrich Bodenhofer,et al.  Incremental Learning of Fuzzy Basis Function Networks with a Modified Version of Vector Quantization , 2006 .

[33]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[34]  Edwin Lughofer,et al.  Premise parameter estimation and adaptation in fuzzy systems with open-loop clustering methods , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[35]  Plamen Angelov,et al.  Agile collaborative autonomous agents for robust underwater classification scenarios , 2005 .

[36]  Plamen P. Angelov,et al.  Flexible models with evolving structure , 2004, Int. J. Intell. Syst..

[37]  Stephen Grossberg,et al.  Adaptive resonance theory: ART , 1998, An Introduction to Neural Networks.