A rapid fuzzy rule clustering method based on granular computing

Graphical abstractDisplay Omitted HighlightsA rapid fuzzy rule clustering method based on granular computing is proposed.Exemplar descriptions are selected from sample's descriptions by relative frequency.Data granulation is guided by the selected exemplar descriptions. Traditionally, clustering is the task of dividing samples into homogeneous clusters based on their degrees of similarity. As samples are assigned to clusters, users need to manually give descriptions for all clusters. In this paper, a rapid fuzzy rule clustering method based on granular computing is proposed to give descriptions for all clusters. A new and simple unsupervised feature selection method is employed to endow every sample with a suitable description. Exemplar descriptions are selected from sample's descriptions by relative frequency, and data granulation is guided by the selected exemplar fuzzy descriptions. Every cluster is depicted by a single fuzzy rule, which make the clusters understandable for humans. The experimental results show that our proposed model is able to discover fuzzy IF-THEN rules to obtain the potential clusters.

[1]  Michael G. Rabbat,et al.  GANC: Greedy agglomerative normalized cut for graph clustering , 2012, Pattern Recognit..

[2]  Yiyu Yao,et al.  Granular computing: Past, present and future , 2008, 2008 IEEE International Conference on Granular Computing.

[3]  Margaret H. Dunham,et al.  Data Mining: Introductory and Advanced Topics , 2002 .

[4]  Benjamin King.  Step-Wise Clustering Procedures , 1967 .

[5]  Ian Witten,et al.  Data Mining , 2000 .

[6]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[7]  J. Mesirov,et al.  Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. , 1999, Science.

[8]  Witold Pedrycz,et al.  Fuzzy Clustering With Viewpoints , 2010, IEEE Transactions on Fuzzy Systems.

[9]  James C. Bezdek,et al.  Fuzzy mathematics in pattern classification , 1973 .

[10]  M. V. Bhat,et al.  An Efficient Clustering Algorithm , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[11]  Blaise Hanczar,et al.  Ensemble methods for biclustering tasks , 2012, Pattern Recognit..

[12]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[13]  Peter Wai-Ming Tsang,et al.  eXploratory K-Means: A new simple and efficient algorithm for gene clustering , 2012, Appl. Soft Comput..

[14]  Eyke Hüllermeier,et al.  FR3: A Fuzzy Rule Learner for Inducing Reliable Classifiers , 2009, IEEE Transactions on Fuzzy Systems.

[15]  Xiaohua Hu,et al.  Exploiting the Social Tagging Network for Web Clustering , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[16]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[17]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[18]  Sukumar Nandi,et al.  A distance based clustering method for arbitrary shaped clusters in large datasets , 2011, Pattern Recognit..

[19]  Nabil H. Mustafa,et al.  k-means projective clustering , 2004, PODS.

[20]  George Panoutsos,et al.  A neural-fuzzy modelling framework based on granular computing: Concepts and applications , 2010, Fuzzy Sets Syst..

[21]  Qing He,et al.  An improved FCMBP fuzzy clustering method based on evolutionary programming , 2011, Comput. Math. Appl..

[22]  Xiaodong Liu,et al.  Applications of axiomatic fuzzy set clustering method on management strategic analysis , 2009, Eur. J. Oper. Res..

[23]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[24]  Xiaodong Liu,et al.  DBCAMM: A novel density based clustering algorithm via using the Mahalanobis metric , 2012, Appl. Soft Comput..

[25]  Lawrence Hubert,et al.  Order-Constrained Solutions in K-Means Clustering: Even Better Than Being Globally Optimal , 2008 .

[26]  George Panoutsos,et al.  Granular computing neural-fuzzy modelling: A neutrosophic approach , 2013, Appl. Soft Comput..

[27]  Joanicjusz Nazarko,et al.  The fuzzy regression approach to peak load estimation in power distribution systems , 1999 .

[28]  Zhong-Yang Xiong,et al.  An efficient clustering algorithm , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[29]  Jitendra Malik,et al.  Spectral grouping using the Nystrom method , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Nor Ashidi Mat Isa,et al.  Novel initialization scheme for Fuzzy C-Means algorithm on color image segmentation , 2013, Appl. Soft Comput..

[31]  Sotirios Chatzis,et al.  Factor Analysis Latent Subspace Modeling and Robust Fuzzy Clustering Using $t$-Distributions , 2009, IEEE Transactions on Fuzzy Systems.

[32]  Xiaodong Liu,et al.  Novel artificial intelligent techniques via AFS theory: Feature selection, concept categorization and characteristic description , 2010, Appl. Soft Comput..

[33]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[34]  Xiaodong Liu,et al.  The fuzzy clustering analysis based on AFS theory , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Mário A. T. Figueiredo,et al.  An unsupervised approach to feature discretization and selection , 2012, Pattern Recognit..

[36]  Hidetomo Ichihashi,et al.  Fuzzy PCA-Guided Robust $k$-Means Clustering , 2010, IEEE Transactions on Fuzzy Systems.

[37]  Witold Pedrycz,et al.  The Development of Fuzzy Rough Sets with the Use of Structures and Algebras of Axiomatic Fuzzy Sets , 2009, IEEE Transactions on Knowledge and Data Engineering.

[38]  Andrzej Bargiela,et al.  Toward a Theory of Granular Computing for Human-Centered Information Processing , 2008, IEEE Transactions on Fuzzy Systems.

[39]  Witold Pedrycz,et al.  Clustering with proximity knowledge and relational knowledge , 2012, Pattern Recognit..

[40]  Witold Pedrycz,et al.  Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study , 2010, Fuzzy Sets Syst..

[41]  Eghbal G. Mansoori,et al.  SGERD: A Steady-State Genetic Algorithm for Extracting Fuzzy Classification Rules From Data , 2008, IEEE Transactions on Fuzzy Systems.

[42]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[43]  Hongbing Liu,et al.  FL-GrCCA: A granular computing classification algorithm based on fuzzy lattices , 2011, Comput. Math. Appl..

[44]  Witold Pedrycz,et al.  Granular Computing: Analysis and Design of Intelligent Systems , 2013 .

[45]  Tao Li,et al.  Entropy-based criterion in categorical clustering , 2004, ICML.

[46]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[47]  Chun Chen,et al.  Locally discriminative topic modeling , 2012, Pattern Recognit..

[48]  Xiangliang Zhang,et al.  K-AP: Generating Specified K Clusters by Efficient Affinity Propagation , 2010, 2010 IEEE International Conference on Data Mining.

[49]  Xiaodong Liu,et al.  Selection of logistics center location using Axiomatic Fuzzy Set and TOPSIS methodology in logistics management , 2011, Expert Syst. Appl..