A Novel Fuzzy c-Means Clustering Algorithm Using Adaptive Norm

The fuzzy c-means (FCM) clustering algorithm is an unsupervised learning method that has been widely applied to cluster unlabeled data automatically instead of artificially, but is sensitive to noisy observations due to its inappropriate treatment of noise in the data. In this paper, a novel method considering noise intelligently based on the existing FCM approach, called adaptive-FCM and its extended version (adaptive-REFCM) in combination with relative entropy, are proposed. Adaptive-FCM, relying on an inventive integration of the adaptive norm, benefits from a robust overall structure. Adaptive-REFCM further integrates the properties of the relative entropy and normalized distance to preserve the global details of the dataset. Several experiments are carried out, including noisy or noise-free University of California Irvine (UCI) clustering and image segmentation experiments. The results show that adaptive-REFCM exhibits better noise robustness and adaptive adjustment in comparison with relevant state-of-the-art FCM methods.

[1]  Sadaaki Miyamoto,et al.  Multisets and Fuzzy Multisets , 2000 .

[2]  Deng Cai,et al.  Improving face recognition with domain adaptation , 2018, Neurocomputing.

[3]  Yu Li,et al.  Mahalanobis distance based on fuzzy clustering algorithm for image segmentation , 2015, Digit. Signal Process..

[4]  Mohammad Hossein Fazel Zarandi,et al.  Relative entropy fuzzy c-means clustering , 2014, Inf. Sci..

[5]  Sadaaki Miyamoto,et al.  On Fuzzy c-Means for Data with Tolerance , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[6]  R. Tibshirani,et al.  Regression shrinkage and selection via the lasso: a retrospective , 2011 .

[7]  Camille Roth,et al.  Natural Scales in Geographical Patterns , 2017, Scientific Reports.

[8]  Krassimir T. Atanassov,et al.  Intuitionistic fuzzy sets , 1986 .

[9]  Peter Bühlmann Regression shrinkage and selection via the Lasso: a retrospective (Robert Tibshirani): Comments on the presentation , 2011 .

[10]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[11]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .

[12]  V. Torra,et al.  A framework for linguistic logic programming , 2010 .

[13]  Huchang Liao,et al.  A Bibliometric Analysis of Fuzzy Decision Research During 1970–2015 , 2016, International Journal of Fuzzy Systems.

[14]  Yu Li,et al.  A Fuzzy Clustering Approach for Complex Color Image Segmentation Based on Gaussian Model with Interactions between Color Planes and Mixture Gaussian Model , 2018, Int. J. Fuzzy Syst..

[15]  Gaston H. Gonnet,et al.  On the LambertW function , 1996, Adv. Comput. Math..

[16]  Long Thanh Ngo,et al.  A Multiple Kernels Interval Type-2 Possibilistic C-Means , 2016 .

[17]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[18]  Xiangyu Chang,et al.  Sparse Regularization in Fuzzy $c$ -Means for High-Dimensional Data Clustering , 2017, IEEE Transactions on Cybernetics.

[19]  Xiaohong Li,et al.  Feature-derived graph regularized matrix factorization for predicting drug side effects , 2018, Neurocomputing.

[20]  James C. Bezdek,et al.  Correction to "On Cluster Validity for the Fuzzy c-Means Model" [Correspondence] , 1997, IEEE Trans. Fuzzy Syst..

[21]  Hong-yu Zhang,et al.  Multi-criteria Group Decision-Making Approach Based on 2-Tuple Linguistic Aggregation Operators with Multi-hesitant Fuzzy Linguistic Information , 2015, International Journal of Fuzzy Systems.

[22]  H. Zou,et al.  Addendum: Regularization and variable selection via the elastic net , 2005 .

[23]  Fuad E. Alsaadi,et al.  Bipolar Fuzzy Hamacher Aggregation Operators in Multiple Attribute Decision Making , 2017, International Journal of Fuzzy Systems.

[24]  Jeng-Ming Yih,et al.  Fuzzy C-means algorithm based on standard mahalanobis distances , 2009 .

[25]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[26]  Yuan Zhang,et al.  Fuzzy clustering with the entropy of attribute weights , 2016, Neurocomputing.

[27]  Le Hoang Son,et al.  Tune Up Fuzzy C-Means for Big Data: Some Novel Hybrid Clustering Algorithms Based on Initial Selection and Incremental Clustering , 2017, Int. J. Fuzzy Syst..

[28]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[29]  Oscar Castillo,et al.  Designing Type-2 Fuzzy Systems Using the Interval Type-2 Fuzzy C-Means Algorithm , 2014, Recent Advances on Hybrid Approaches for Designing Intelligent Systems.

[30]  Qinghua Zheng,et al.  Adaptive Unsupervised Feature Selection With Structure Regularization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[31]  J. Bezdek A Physical Interpretation of Fuzzy ISODATA , 1993 .

[32]  Sivakami Raja,et al.  An Efficient Fuzzy-Based Hybrid System to Cloud Intrusion Detection , 2016, International Journal of Fuzzy Systems.

[33]  Feiping Nie,et al.  Capped Lp-Norm Graph Embedding for Photo Clustering , 2016, ACM Multimedia.

[34]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[35]  Jian-qiang Wang,et al.  An Interval Type-2 Fuzzy Likelihood-Based MABAC Approach and Its Application in Selecting Hotels on a Tourism Website , 2017, Int. J. Fuzzy Syst..

[36]  Fang Liu,et al.  Fuzzy Double C-Means Clustering Based on Sparse Self-Representation , 2018, IEEE Transactions on Fuzzy Systems.

[37]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[38]  Oleksii K. Tyshchenko,et al.  Fuzzy Clustering Data Given on the Ordinal Scale Based on Membership and Likelihood Functions Sharing , 2017, ArXiv.

[39]  F. Klawonn,et al.  Fuzzy clustering with weighting of data variables , 2000 .

[40]  Fei Wen,et al.  Robust sparse recovery for compressive sensing in impulsive noise using ℓp-norm model fitting , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Alan Wee-Chung Liew,et al.  Spatial Possibilistic Fuzzy C-Mean Segmentation Algorithm Integrated with Brain Mid-sagittal Surface Information , 2017, Int. J. Fuzzy Syst..

[42]  Sadaaki Miyamoto,et al.  Comparison of tolerant fuzzy c-means clustering with L2- and L1-regularization , 2009, 2009 IEEE International Conference on Granular Computing.

[43]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[44]  Bor-Chen Kuo,et al.  A New Weighted Fuzzy C-Means Clustering Algorithm for Remotely Sensed Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[45]  Hsiang-Chuan Liu,et al.  Fuzzy C-Means Algorithm Based on Common Mahalanobis Distances , 2009, J. Multiple Valued Log. Soft Comput..

[46]  Francisco Herrera,et al.  Hesitant Fuzzy Linguistic Term Set and Its Application in Decision Making: A State-of-the-Art Survey , 2017, International Journal of Fuzzy Systems.