Recursive clustering based on a Gustafson–Kessel algorithm

In this paper an on-line fuzzy identification of Takagi Sugeno fuzzy model is presented. The presented method combines a recursive Gustafson–Kessel clustering algorithm and the fuzzy recursive least squares method. The on-line Gustafson–Kessel clustering method is derived. The recursive equations for fuzzy covariance matrix, its inverse and cluster centers are given. The use of the method is presented on two examples. First example demonstrates the use of the method for monitoring of the waste water treatment process and in the second example the method is used to develop an adaptive fuzzy predictive functional controller for a pH process. The results for the Mackey–Glass time series prediction are also given.

[1]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[2]  Roderick Murray-Smith,et al.  The operating regime approach to nonlinear modelling and control , 1997 .

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  Plamen Angelov,et al.  Evolving Intelligent Systems: Methodology and Applications , 2010 .

[5]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[6]  Igor Škrjanc,et al.  Predictive functional control based on fuzzy model for heat-exchanger pilot plant , 1999 .

[7]  Erkki Oja,et al.  Rival penalized competitive learning for clustering analysis, RBF net, and curve detection , 1993, IEEE Trans. Neural Networks.

[8]  Spyros G. Tzafestas,et al.  NeuroFAST: on-line neuro-fuzzy ART-based structure and parameter learning TSK model , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Euntai Kim,et al.  A new approach to fuzzy modeling , 1997, IEEE Trans. Fuzzy Syst..

[10]  Chih-Lyang Hwang,et al.  Fuzzy Neural-Based Control for Nonlinear , 2007 .

[11]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[12]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[13]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[14]  L. Glass,et al.  Oscillation and chaos in physiological control systems. , 1977, Science.

[15]  Xiao-Jun Zeng,et al.  An incremental construction learning algorithm for identification of T-S Fuzzy Systems , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[16]  Chih-Lyang Hwang,et al.  Fuzzy Neural-Based Control for Nonlinear Time-Varying Delay Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Ronald R. Yager,et al.  Learning of Fuzzy Rules by Mountain Clustering , 1992 .

[18]  Chin-Teng Lin,et al.  A neural fuzzy control system with structure and parameter learning , 1995 .

[19]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[20]  Chih-Hong Lin,et al.  Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive , 2001, IEEE Trans. Fuzzy Syst..

[21]  Junfei Qiao,et al.  A self-organizing fuzzy neural network and its applications to function approximation and forecast modeling , 2008, Neurocomputing.

[22]  Madasu Hanmandlu,et al.  Structure identification of generalized adaptive neuro-fuzzy inference systems , 2003, IEEE Trans. Fuzzy Syst..

[23]  Dale E. Seborg,et al.  Adaptive nonlinear control of a pH neutralization process , 1994, IEEE Trans. Control. Syst. Technol..

[24]  Plamen Angelov,et al.  Evolving Takagi-Sugeno fuzzy systems from data streams (eTS+). , 2010 .

[25]  Babak Nadjar Araabi,et al.  Recursive Gath–Geva clustering as a basis for evolving neuro-fuzzy modeling , 2010, Evol. Syst..

[26]  Olga Georgieva,et al.  An Extended Version ofGustafson-Kessel Clustering Algorithm for Evolving Data Stream Clustering Evolving Intelligent Systems: Methodology and Applications , 2010 .

[27]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[28]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  B. Pasik-Duncan,et al.  Adaptive Control , 1996, IEEE Control Systems.

[30]  Hiroyuki Watanabe,et al.  Application of a fuzzy discrimination analysis for diagnosis of valvular heart disease , 1994, IEEE Trans. Fuzzy Syst..

[31]  Meng Joo Er,et al.  A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks , 2001, IEEE Trans. Fuzzy Syst..

[32]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[33]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[34]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[35]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[36]  Emil Levi,et al.  Identification of complex systems based on neural and Takagi-Sugeno fuzzy model , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Nikola K. Kasabov,et al.  Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems , 1996, Fuzzy Sets Syst..

[38]  Chin-Teng Lin,et al.  An On-Line Self-Constructing Neural Fuzzy Inference Network and Its Applications , 1998 .

[39]  Plamen Angelov,et al.  Evolving Rule-Based Models: A Tool For Design Of Flexible Adaptive Systems , 2002 .

[40]  Plamen P. Angelov,et al.  An approach for fuzzy rule-base adaptation using on-line clustering , 2004, Int. J. Approx. Reason..

[41]  T. Martin McGinnity,et al.  An on-line algorithm for creating self-organizing fuzzy neural networks , 2004, Neural Networks.

[42]  Igor Škrjanc,et al.  Fuzzy predictive functional control with adaptive fuzzy model , 2010, 2010 International Joint Conference on Computational Cybernetics and Technical Informatics.

[43]  António Dourado,et al.  Structure and parameter learning of neuro-fuzzy systems: A methodology and a comparative study , 2001 .

[44]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).