Rough possibilistic C-means clustering based on multigranulation approximation regions and shadowed sets

Abstract The management of uncertain information in a data set is crucial for clustering models. In this study, we present a rough possibilistic C-means clustering approach based on multigranulation approximation regions and shadowed sets, which can handle the uncertainties implicated in data and generated by the model parameters simultaneously. In particular, all patterns are first partitioned into three approximation regions with respect to a fixed cluster according to their possibilistic membership degrees based on shadowed set theory, which can help capture the natural topology of the data, especially when dealing with outliers and noisy data. The multigranulation approximation regions of each cluster can then be formed under a series of fuzzifier values, where the uncertainty caused by a specific fuzzifier value can be detected based on variations in the approximation regions with different levels of granularity. We also introduce a framework for updating prototypes based on ensemble strategies to attenuate the distortions due to iteration during clustering procedures. Finally, an adaptive mechanism is developed for dynamically adjusting scale parameters based on the notion of the maximal compatible regions of clusters. By integrating various granular computing techniques, i.e., rough sets, fuzzy sets, shadowed sets, and the notion of multigranulation, the uncertainties implicated in data and produced by model parameters can be adequately addressed, and the possibilistic membership values involved make the method sufficiently robust to deal with noisy environments. The improved performance of the proposed approach was demonstrated in experiments based on the comparisons with other available fuzzy and possibilistic clustering methods.

[1]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[2]  Athanasios A. Rontogiannis,et al.  Sparsity-Aware Possibilistic Clustering Algorithms , 2015, IEEE Transactions on Fuzzy Systems.

[3]  Rajesh N. Davé,et al.  Robust clustering methods: a unified view , 1997, IEEE Trans. Fuzzy Syst..

[4]  Xiaohong Zhang,et al.  Constructive methods of rough approximation operators and multigranulation rough sets , 2016, Knowl. Based Syst..

[5]  Yiyu Yao,et al.  Three-Way Decisions and Cognitive Computing , 2016, Cognitive Computation.

[6]  Yiyu Yao,et al.  Decision-theoretic three-way approximations of fuzzy sets , 2014, Inf. Sci..

[7]  Witold Pedrycz,et al.  Shadowed sets in the characterization of rough-fuzzy clustering , 2011, Pattern Recognit..

[8]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[9]  Witold Pedrycz,et al.  Rough–Fuzzy Collaborative Clustering , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Athanasios A. Rontogiannis,et al.  A Novel Adaptive Possibilistic Clustering Algorithm , 2014, IEEE Transactions on Fuzzy Systems.

[11]  James M. Keller,et al.  The possibilistic C-means algorithm: insights and recommendations , 1996, IEEE Trans. Fuzzy Syst..

[12]  Hamido Fujita,et al.  An incremental attribute reduction approach based on knowledge granularity with a multi-granulation view , 2017, Inf. Sci..

[13]  Yiyu Yao,et al.  Constructing shadowed sets and three-way approximations of fuzzy sets , 2017, Inf. Sci..

[14]  Yuhua Qian,et al.  Multigranulation fuzzy rough set over two universes and its application to decision making , 2017, Knowl. Based Syst..

[15]  Weihua Xu,et al.  Granular Computing Approach to Two-Way Learning Based on Formal Concept Analysis in Fuzzy Datasets , 2016, IEEE Transactions on Cybernetics.

[16]  Yiyu Yao,et al.  An Outline of a Theory of Three-Way Decisions , 2012, RSCTC.

[17]  Przemyslaw Grzegorzewski,et al.  Fuzzy number approximation via shadowed sets , 2013, Inf. Sci..

[18]  Pradipta Maji,et al.  Rough-Fuzzy Clustering for Grouping Functionally Similar Genes from Microarray Data , 2013, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[19]  Ricardo J. G. B. Campello,et al.  A fuzzy extension of the Rand index and other related indexes for clustering and classification assessment , 2007, Pattern Recognit. Lett..

[20]  Weihua Xu,et al.  A novel approach to information fusion in multi-source datasets: A granular computing viewpoint , 2017, Inf. Sci..

[21]  M. H. Fazel Zarandi,et al.  Interval type-2 credibilistic clustering for pattern recognition , 2015, Pattern Recognit..

[22]  Yiyu Yao,et al.  Granular Computing: basic issues and possible solutions , 2007 .

[23]  Witold Pedrycz,et al.  Granular Fuzzy Possibilistic C-Means Clustering approach to DNA microarray problem , 2017, Knowl. Based Syst..

[24]  Can Gao,et al.  Maximum decision entropy-based attribute reduction in decision-theoretic rough set model , 2017, Knowl. Based Syst..

[25]  Hamido Fujita,et al.  Hierarchical cluster ensemble model based on knowledge granulation , 2016, Knowl. Based Syst..

[26]  HaiYan Yu,et al.  Cutset-type possibilistic c-means clustering algorithm , 2018, Appl. Soft Comput..

[27]  Oscar Castillo,et al.  An Extension of the Fuzzy Possibilistic Clustering Algorithm Using Type-2 Fuzzy Logic Techniques , 2017, Adv. Fuzzy Syst..

[28]  Shaswati Roy,et al.  Rough-fuzzy clustering and multiresolution image analysis for text-graphics segmentation , 2015, Appl. Soft Comput..

[29]  Yiyu Yao,et al.  Rough-set concept analysis: Interpreting RS-definable concepts based on ideas from formal concept analysis , 2016, Inf. Sci..

[30]  Jiang-She Zhang,et al.  Improved possibilistic C-means clustering algorithms , 2004, IEEE Trans. Fuzzy Syst..

[31]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[32]  James C. Bezdek,et al.  Extending Information-Theoretic Validity Indices for Fuzzy Clustering , 2017, IEEE Transactions on Fuzzy Systems.

[33]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[34]  Witold Pedrycz,et al.  Shadowed sets: representing and processing fuzzy sets , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[35]  Charu C. Aggarwal,et al.  Data Clustering : Algorithms and Applications , 2012 .

[36]  Ujjwal Maulik,et al.  Rough Possibilistic Type-2 Fuzzy C-Means clustering for MR brain image segmentation , 2016, Appl. Soft Comput..

[37]  Oscar Castillo,et al.  Interval Type-2 Fuzzy Possibilistic C-Means Clustering Algorithm , 2014, WCSC.

[38]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[39]  Frank Chung-Hoon Rhee,et al.  Uncertain Fuzzy Clustering: Interval Type-2 Fuzzy Approach to $C$-Means , 2007, IEEE Transactions on Fuzzy Systems.

[40]  Yiyu Yao,et al.  A unified model of sequential three-way decisions and multilevel incremental processing , 2017, Knowl. Based Syst..

[41]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[42]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[43]  Ali Selamat,et al.  Systematic mapping study on granular computing , 2015, Knowl. Based Syst..

[44]  Chris H. Q. Ding,et al.  On Trivial Solution and Scale Transfer Problems in Graph Regularized NMF , 2011, IJCAI.

[45]  Sankar K. Pal,et al.  Rough Set Based Generalized Fuzzy $C$ -Means Algorithm and Quantitative Indices , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Pawan Lingras,et al.  Interval Set Clustering of Web Users with Rough K-Means , 2004, Journal of Intelligent Information Systems.

[47]  Witold Pedrycz,et al.  From fuzzy sets to shadowed sets: Interpretation and computing , 2009, Int. J. Intell. Syst..

[48]  Weihua Xu,et al.  Generalized multigranulation double-quantitative decision-theoretic rough set , 2016, Knowl. Based Syst..

[49]  Jing-Yu Yang,et al.  Multigranulation rough set: A multiset based strategy , 2017, Int. J. Comput. Intell. Syst..

[50]  Can Gao,et al.  Multigranulation rough-fuzzy clustering based on shadowed sets , 2020, Inf. Sci..

[51]  Athanasios A. Rontogiannis,et al.  On the Convergence of the Sparse Possibilistic C-Means Algorithm , 2015, IEEE Transactions on Fuzzy Systems.