A study on multi-kernel intuitionistic fuzzy C-means clustering with multiple attributes

Abstract Fuzzy C-means (FCM) clustering has been widely applied in various data-driven applications. While traditional FCM clustering algorithms handle uncertainty with type-2 Fuzzy Sets (T2 FSs), the recently-proposed intuitionistic fuzzy sets (IFSs) have shown advantages for describing vague and uncertain data by taking both membership degree and non-membership degree into account. However, intuitionistic fuzzy C-means (IFCM) algorithms generally do not take the importance of individual attributes and the structure of the data into account, when multi-modal and imbalanced features are involved in an application. Therefore, in this paper, we propose to address this issue of IFCM with multi-kernel mapping. First, different types of features are grouped. Second, a composite kernel is constructed to map each attribute group into an individual kernel space and to linearly combine these kernels with optimimal weights. Comprehensive experiments have been conducted on a wide range of datasets, such as machine learning repository (UCI) dataset, fabric dataset, hyperspectral imaging classification and MRI brain images segmentation to demonstrate the superior performance of the proposed clustering algorithm in comparison with the state-of-the-art in the field.

[1]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[2]  Aditi Sharan,et al.  An improved intuitionistic fuzzy c-means clustering algorithm incorporating local information for brain image segmentation , 2016, Appl. Soft Comput..

[3]  Frank Chung-Hoon Rhee,et al.  Uncertain Fuzzy Clustering: Interval Type-2 Fuzzy Approach to $C$-Means , 2007, IEEE Transactions on Fuzzy Systems.

[4]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[5]  David A. Clausi,et al.  Design-based texture feature fusion using Gabor filters and co-occurrence probabilities , 2005, IEEE Transactions on Image Processing.

[6]  Pier Luca Lanzi,et al.  A novel intuitionistic fuzzy clustering method for geo-demographic analysis , 2012, Expert Syst. Appl..

[7]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis: Ranking, clustering and data visualisation , 2004 .

[8]  Palma Blonda,et al.  A survey of fuzzy clustering algorithms for pattern recognition. I , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Zhiyong Wang,et al.  Hyperspectral Image Classification With Global–Local Discriminant Analysis and Spatial–Spectral Context , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[11]  Daoqiang Zhang,et al.  Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation , 2007, Pattern Recognit..

[12]  Bao Qing Hu,et al.  On type-2 fuzzy relations and interval-valued type-2 fuzzy sets , 2014, Fuzzy Sets Syst..

[13]  Witold Pedrycz,et al.  Performance of kernel-based fuzzy clustering , 2007 .

[14]  Maoguo Gong,et al.  Fuzzy Clustering With a Modified MRF Energy Function for Change Detection in Synthetic Aperture Radar Images , 2014, IEEE Transactions on Fuzzy Systems.

[15]  Fang Liu,et al.  Fuzzy Double C-Means Clustering Based on Sparse Self-Representation , 2018, IEEE Transactions on Fuzzy Systems.

[16]  Ujjwal Maulik,et al.  A study of some fuzzy cluster validity indices, genetic clustering and application to pixel classification , 2005, Fuzzy Sets Syst..

[17]  Korris Fu-Lai Chung,et al.  Generalized Fuzzy C-Means Clustering Algorithm With Improved Fuzzy Partitions , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Nikos Pelekis,et al.  Intuitionistic Fuzzy Clustering with Applications in Computer Vision , 2008, ACIVS.

[19]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Ujjwal Maulik,et al.  Performance Evaluation of Some Clustering Algorithms and Validity Indices , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Xiuying Wang,et al.  A Unified Collaborative Multikernel Fuzzy Clustering for Multiview Data , 2018, IEEE Transactions on Fuzzy Systems.

[22]  C. L. Philip Chen,et al.  A Multiple-Kernel Fuzzy C-Means Algorithm for Image Segmentation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Zeshui Xu,et al.  Intuitionistic fuzzy C-means clustering algorithms , 2010 .

[24]  Witold Pedrycz,et al.  Towards hybrid clustering approach to data classification: Multiple kernels based interval-valued Fuzzy C-Means algorithms , 2015, Fuzzy Sets Syst..

[25]  Milos Manic,et al.  General Type-2 Fuzzy C-Means Algorithm for Uncertain Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[26]  S.M. Szilagyi,et al.  MR brain image segmentation using an enhanced fuzzy C-means algorithm , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[27]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[28]  Kuo-Ping Lin,et al.  A Novel Evolutionary Kernel Intuitionistic Fuzzy $C$ -means Clustering Algorithm , 2014, IEEE Transactions on Fuzzy Systems.

[29]  Miin-Shen Yang,et al.  A Gaussian kernel-based fuzzy c-means algorithm with a spatial bias correction , 2008, Pattern Recognit. Lett..

[30]  Hichem Frigui,et al.  Fuzzy clustering with Multiple Kernels , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[31]  Q. M. Jonathan Wu,et al.  Online Feature Selection Based on Fuzzy Clustering and Its Applications , 2016, IEEE Transactions on Fuzzy Systems.

[32]  Tamalika Chaira,et al.  A novel intuitionistic fuzzy C means clustering algorithm and its application to medical images , 2011, Appl. Soft Comput..

[33]  Zexuan Ji,et al.  Interval-valued possibilistic fuzzy C-means clustering algorithm , 2014, Fuzzy Sets Syst..

[34]  Xiangyu Chang,et al.  Sparse Regularization in Fuzzy $c$ -Means for High-Dimensional Data Clustering , 2017, IEEE Transactions on Cybernetics.

[35]  Chang-Dong Wang,et al.  Ensemble clustering using factor graph , 2016, Pattern Recognit..

[36]  Joshua Zhexue Huang,et al.  Incremental density-based ensemble clustering over evolving data streams , 2016, Neurocomputing.

[37]  Shitong Wang,et al.  Attribute weighted mercer kernel based fuzzy clustering algorithm for general non-spherical datasets , 2006, Soft Comput..

[38]  Chang-Dong Wang,et al.  Locally Weighted Ensemble Clustering , 2016, IEEE Transactions on Cybernetics.

[39]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..