Clustering as a tool for self-generation of intelligent systems : a survey.

Fuzzy Rule Based (FRB) and Neuro-fuzzy systems are commonly used as a basis for intelligent systems due to their transparent and simple human interpretable structure. One of the crucial steps in designing FRB and neuro-fuzzy systems is to innovate the rule base. Data clustering is one of the approaches that have been applied extensively to automatically generate rules from input-output data. The goal of this paper is to critically review some of the most commonly used as well as recently developed clustering techniques, emphasizing their use in rule base generation. The paper explores the shift from offline clustering techniques to online and finally to evolving techniques that originated due to the current demand of adaptive systems.

[1]  Edwin Lughofer,et al.  FLEXFIS: A Robust Incremental Learning Approach for Evolving Takagi–Sugeno Fuzzy Models , 2008, IEEE Transactions on Fuzzy Systems.

[2]  Nikola Kasabov,et al.  Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines , 2002, IEEE Transactions on Neural Networks.

[3]  Chuen-Tsai Sun,et al.  Functional equivalence between radial basis function networks and fuzzy inference systems , 1993, IEEE Trans. Neural Networks.

[4]  Hossein Salehfar,et al.  A systematic approach to linguistic fuzzy modeling based on input-output data , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[5]  Plamen P. Angelov,et al.  Evolving Fuzzy-Rule-Based Classifiers From Data Streams , 2008, IEEE Transactions on Fuzzy Systems.

[6]  Dimitar Filev,et al.  Gustafson-Kessel algorithm for evolving data stream clustering , 2009, CompSysTech '09.

[7]  Kudret Demirli,et al.  Autonomous parallel parking of a car-like mobile robot by a neuro-fuzzy behavior-based controller , 2005, NAFIPS 2005.

[8]  Michio Sugeno,et al.  A fuzzy-logic-based approach to qualitative modeling , 1993, IEEE Trans. Fuzzy Syst..

[9]  Seema Chopra,et al.  Identification of rules using subtractive clustering with application to fuzzy controllers , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[10]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[11]  Karen L. McGraw,et al.  Knowledge Acquisition: Principles and Guidelines , 1989 .

[12]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Stephen L. Chiu,et al.  Extracting Fuzzy Rules from Data for Function Approximation and Pattern Classification , 2000 .

[14]  Michio Sugeno,et al.  Fuzzy identification of systems and its applications to modeling and control , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  L.O. Hall,et al.  Online fuzzy c means , 2008, NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society.

[16]  R. Babuška,et al.  A new identification method for linguistic fuzzy models , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[17]  P. Angelov,et al.  Evolving Fuzzy Systems from Data Streams in Real-Time , 2006, 2006 International Symposium on Evolving Fuzzy Systems.

[18]  Plamen P. Angelov,et al.  Flexible models with evolving structure , 2004, Int. J. Intell. Syst..

[19]  Shonali Krishnaswamy,et al.  Mining data streams: a review , 2005, SGMD.

[20]  Lawrence O. Hall,et al.  A fuzzy c means variant for clustering evolving data streams , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[21]  V. Ravi,et al.  On-Line Evolving Fuzzy Clustering , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[22]  Plamen P. Angelov,et al.  Adaptive Inferential Sensors Based on Evolving Fuzzy Models , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  K. Woo,et al.  Linguistic fuzzy model identification , 1995 .

[24]  R. Yager,et al.  Approximate Clustering Via the Mountain Method , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[25]  Kwang Bo Cho,et al.  Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction , 1996, Fuzzy Sets Syst..

[26]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[27]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[28]  Renxia Wan,et al.  A Weighted Fuzzy Clustering Algorithm for Data Stream , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[29]  Tzung-Pei Hong,et al.  Finding relevant attributes and membership functions , 1999, Fuzzy Sets Syst..

[30]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[31]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[32]  Plamen P. Angelov,et al.  Identification of evolving fuzzy rule-based models , 2002, IEEE Trans. Fuzzy Syst..

[33]  Plamen P. Angelov,et al.  An approach for fuzzy rule-base adaptation using on-line clustering , 2004, Int. J. Approx. Reason..

[34]  R. Gorez,et al.  A fuzzy clustering method for the identification of fuzzy models for dynamic systems , 1994, Proceedings of 1994 9th IEEE International Symposium on Intelligent Control.

[35]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[36]  Ronald R. Yager,et al.  Learning of Fuzzy Rules by Mountain Clustering , 1992 .

[37]  Yinghua Lin,et al.  A fuzzy approach to input variable identification , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[38]  Nikhil R. Pal,et al.  Soft computing for feature analysis , 1999, Fuzzy Sets Syst..

[39]  E. H. Mamdani,et al.  Application of Fuzzy Logic to Approximate Reasoning Using Linguistic Synthesis , 1976, IEEE Transactions on Computers.

[40]  Klaus Nordhausen,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition by Trevor Hastie, Robert Tibshirani, Jerome Friedman , 2009 .

[41]  Jerry M. Mendel,et al.  Generating fuzzy rules by learning from examples , 1992, IEEE Trans. Syst. Man Cybern..

[42]  Francisco Herrera,et al.  Ten years of genetic fuzzy systems: current framework and new trends , 2004, Fuzzy Sets Syst..

[43]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[44]  Andrew A. Goldenberg,et al.  Development of a systematic methodology of fuzzy logic modeling , 1998, IEEE Trans. Fuzzy Syst..

[45]  Kudret Demirli,et al.  Autonomous parallel parking of a car-like mobile robot by a neuro-fuzzy behavior-based controller , 2005, NAFIPS 2005 - 2005 Annual Meeting of the North American Fuzzy Information Processing Society.

[46]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[47]  Hung-Yuan Chung,et al.  A self-learning fuzzy logic controller using genetic algorithms with reinforcements , 1997, IEEE Trans. Fuzzy Syst..

[48]  H. Ishibuchi,et al.  Empirical study on learning in fuzzy systems by rice taste analysis , 1994 .

[49]  Stephen L. Chiu,et al.  Fuzzy Model Identification Based on Cluster Estimation , 1994, J. Intell. Fuzzy Syst..

[50]  Qun Song.  Weighted Data Normalization and Feature Selection for Evolving Connectionist Systems Proceedings , 2003 .

[51]  Witold Pedrycz,et al.  Advances in Fuzzy Clustering and its Applications , 2007 .

[52]  Plamen Angelov,et al.  Evolving Rule-Based Models: A Tool For Design Of Flexible Adaptive Systems , 2002 .

[53]  Wei Liang,et al.  Fuzzy C-means algorithm in work condition recognition of oil pipeline , 2009, 2009 4th IEEE Conference on Industrial Electronics and Applications.

[54]  Plamen P. Angelov,et al.  Simpl_eTS: a simplified method for learning evolving Takagi-Sugeno fuzzy models , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[55]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[56]  Charu C. Aggarwal,et al.  Data Streams - Models and Algorithms , 2014, Advances in Database Systems.

[57]  Witold Pedrycz.  A dynamic data granulation through adjustable fuzzy clustering , 2008, Pattern Recognit. Lett..

[58]  Robert Babuška,et al.  An overview of fuzzy modeling for control , 1996 .

[59]  P. Angelov,et al.  Evolving rule-based models: A tool for intelligent adaptation , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[60]  Z. Zenn Bien,et al.  Iterative Fuzzy Clustering Algorithm With Supervision to Construct Probabilistic Fuzzy Rule Base From Numerical Data , 2008, IEEE Transactions on Fuzzy Systems.

[61]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  F. Klawonn.  Fuzzy sets and vague environments , 1994 .

[63]  Frank Klawonn,et al.  Foundations of fuzzy systems , 1994 .

[64]  Plamen P. Angelov,et al.  Automatic generation of fuzzy rule-based models from data by genetic algorithms , 2003, Inf. Sci..