A Novel Multiple Fuzzy Clustering Method Based on Internal Clustering Validation Measures with Gradient Descent

In this paper, we propose a novel multiple fuzzy clustering method based on internal clustering validation measures with gradient descent. Firstly, some single fuzzy clustering algorithms such as Fuzzy C-Means, Kernel Fuzzy C-Means and Gustafson–Kessel are used to construct similarity matrixes for each partition. Secondly, those similarity matrixes are aggregated into a final one by means of the direct sum of weighted vectors where the values of weights are determined by internal clustering validation measures. Finally, final membership matrix is calculated by minimizing the sum of square errors through the gradient descent method. The proposed approach has been validated in terms of clustering quality on UCI Machine Learning Repository datasets. Experimental results show that the proposed approach’s performance is better than those of other ensemble and standalone methods.

[1]  Marie-Jeanne Lesot Gustafson-Kessel-like clustering algorithm based on typicality degrees , 2006 .

[2]  Witold Pedrycz,et al.  Advances in Fuzzy Clustering and its Applications , 2007 .

[3]  Chih-Cheng Tseng,et al.  Robust Interval Competitive Agglomeration Clustering Algorithm with Outliers , 2010 .

[4]  B. Shirazi,et al.  A Graph Based Approach for Clustering Ensemble of Fuzzy Partitions , 2013 .

[5]  Ricardo J. G. B. Campello,et al.  Relative clustering validity criteria: A comparative overview , 2010 .

[6]  F. Klawonn,et al.  Can Fuzzy Clustering Avoid Local Minima and Undesired Partitions , 2013 .

[7]  Daoqiang Zhang,et al.  Fuzzy clustering using kernel method , 2002 .

[8]  S. Miyamoto Different Objective Functions in Fuzzy c-Means Algorithms and Kernel-Based Clustering , 2011 .

[9]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[10]  Ming He,et al.  Multiple fuzzy model-based temperature predictive control for HVAC systems , 2005, Inf. Sci..

[11]  C. L. Philip Chen,et al.  A Multiple-Kernel Fuzzy C-Means Algorithm for Image Segmentation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Bipin Kumar Tripathi,et al.  Evolutionary fuzzy clustering and functional modular neural network-based human recognition , 2012, Neural Computing and Applications.

[13]  Le Hoang Son,et al.  Intuitionistic fuzzy recommender systems: An effective tool for medical diagnosis , 2015, Knowl. Based Syst..

[14]  G. Valentini,et al.  Ensemble Clustering with a Fuzzy Approach , 2008 .

[15]  Horng-Lin Shieh A Hybrid Fuzzy Clustering Method with a Robust Validity Index , 2014 .

[16]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[17]  Hamid Parvin,et al.  To improve the quality of cluster ensembles by selecting a subset of base clusters , 2014, J. Exp. Theor. Artif. Intell..

[18]  Sandro Vega-Pons,et al.  A Survey of Clustering Ensemble Algorithms , 2011, Int. J. Pattern Recognit. Artif. Intell..

[19]  Carla E. Brodley,et al.  Solving cluster ensemble problems by bipartite graph partitioning , 2004, ICML.

[20]  Ricardo J. G. B. Campello,et al.  Relative clustering validity criteria: A comparative overview , 2010, Stat. Anal. Data Min..

[21]  Roberto Avogadri,et al.  Fuzzy ensemble clustering based on random projections for DNA microarray data analysis , 2009, Artif. Intell. Medicine.

[22]  Pier Luca Lanzi,et al.  A novel intuitionistic fuzzy clustering method for geo-demographic analysis , 2012, Expert Syst. Appl..

[23]  Le Hoang Son DPFCM: A novel distributed picture fuzzy clustering method on picture fuzzy sets , 2015, Expert Syst. Appl..

[24]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[25]  Witold Pedrycz,et al.  Design of Similarity and Dissimilarity Measures for Fuzzy Sets on the Basis of Distance Measure , 2009 .

[26]  Le Hoang Son,et al.  A lossless DEM compression for fast retrieval method using fuzzy clustering and MANFIS neural network , 2014, Eng. Appl. Artif. Intell..

[27]  Huimin Wang,et al.  Risk Analysis of Flood Disaster Based on Fuzzy Clustering Method , 2011 .

[28]  Le Hoang Son A novel kernel fuzzy clustering algorithm for Geo-Demographic Analysis , 2015, Inf. Sci..