Incremental Hyperplane-based Fuzzy Clustering for System Modeling

In this paper, a new incremental hyperplane-based fuzzy clustering method to design a Takagi-Sugeno-Kang (TSK) fuzzy model is proposed. Starting from no rule, it generates clusters based on input similarity and distance from the consequent hyperplane incrementally. Membership functions (MFs) are defined with statistical means and deviations of partitioned data. With this configuration, the obtained clusters reflect the real distribution of the training data properly. The training equations are changed to recursive forms in order to be applied in incremental framework. Some heuristic techniques to guarantee the initial training of each local submodel is used. In order to reduce the dependency on the order of training data, merge step is performed. Merge step is not only important for keeping rule bases compact and interpretable, but also provides the robustness to noise. Some simulations are done to show the advantages and performance of the proposed method.

[1]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[2]  Wan-Jui Lee,et al.  A TSK-type neurofuzzy network approach to system modeling problems , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Magne Setnes,et al.  Supervised fuzzy clustering for rule extraction , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[4]  Shie-Jue Lee,et al.  A neuro-fuzzy system modeling with self-constructing rule generationand hybrid SVD-based learning , 2003, IEEE Trans. Fuzzy Syst..

[5]  Nikola Kasabov,et al.  Evolving Self-Organizing Maps for On-line Learning, Data Analysis and Modelling , 2000 .

[6]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[7]  Chang-Hyun Kim,et al.  Evolving Compact and Interpretable Takagi–Sugeno Fuzzy Models With a New Encoding Scheme , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Meng Joo Er,et al.  Dynamic fuzzy neural networks-a novel approach to function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Nikola K. Kasabov,et al.  ESOM: an algorithm to evolve self-organizing maps from online data streams , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[10]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  D.P. Filev,et al.  An approach to online identification of Takagi-Sugeno fuzzy models , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  John C. Platt A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.