NCM: Neutrosophic c-means clustering algorithm

Abstract In this paper, a new clustering algorithm, neutrosophic c -means (NCM), is introduced for uncertain data clustering, which is inspired from fuzzy c -means and the neutrosophic set framework. To derive such a structure, a novel suitable objective function is defined and minimized, and the clustering problem is formulated as a constrained minimization problem, whose solution depends on the objective function. In the objective function, two new types of rejection have been introduced: the ambiguity rejection which concerns the patterns lying near the cluster boundaries, and the distance rejection dealing with patterns that are far away from all the clusters. These measures are able to manage uncertainty due to imprecise and/or incomplete definition of the clusters. We conducted several experiments with synthetic and real data sets. The results are encouraging and compared favorably with results from other methods as FCM, PCM and FPCM algorithms on the same data sets. Finally, the proposed method was applied into image segmentation algorithm. The experimental results show that the proposed algorithm can be considered as a promising tool for data clustering and image processing.

[1]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[2]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[3]  F. Rhee,et al.  A type-2 fuzzy C-means clustering algorithm , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  James M. Keller,et al.  A possibilistic fuzzy c-means clustering algorithm , 2005, IEEE Transactions on Fuzzy Systems.

[6]  S. Sen,et al.  Clustering of relational data containing noise and outliers , 1998, 1998 IEEE International Conference on Fuzzy Systems Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36228).

[7]  Palma Blonda,et al.  A survey of fuzzy clustering algorithms for pattern recognition. I , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[8]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[9]  Rajesh N. Davé,et al.  Characterization and detection of noise in clustering , 1991, Pattern Recognit. Lett..

[10]  Yi Pan,et al.  Improved K-means clustering algorithm for exploring local protein sequence motifs representing common structural property , 2005, IEEE Transactions on NanoBioscience.

[11]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[12]  F. Chung-Hoon Rhee Uncertain Fuzzy Clustering: Insights and Recommendations , 2007 .

[13]  Peter J. Rousseeuw,et al.  Clustering by means of medoids , 1987 .

[14]  Yanhui Guo,et al.  A New Neutrosophic Approach to Image Denoising , 2008 .

[15]  Sarjinder Singh,et al.  Neurofuzzy and neutrosophic approach to compute the rate of change in new economies , 2002 .

[16]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[17]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[18]  James M. Keller,et al.  A possibilistic approach to clustering , 1993, IEEE Trans. Fuzzy Syst..

[19]  Herman Chernoff,et al.  Cluster Analysis for Applications (Michael R. Anderberg) , 1975 .

[20]  F. Smarandache A Unifying Field in Logics: Neutrosophic Logic. , 1999 .

[21]  Milos Manic,et al.  General Type-2 Fuzzy C-Means Algorithm for Uncertain Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[22]  Cheul Hwang,et al.  [IEEE Joint 9th IFSA World Congress and 20th NAFIPS International Conference - Vancouver, BC, Canada (25-28 July 2001)] Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569) - A type-2 fuzzy C-means clustering algorithm , 2001 .

[23]  Heng-Da Cheng,et al.  A NEW NEUTROSOPHIC APPROACH TO IMAGE THRESHOLDING , 2008 .

[24]  Lequan Min,et al.  Novel modified fuzzy c-means algorithm with applications , 2009, Digit. Signal Process..

[25]  Jian Yu,et al.  Alpha-Cut Implemented Fuzzy Clustering Algorithms and Switching Regressions , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Thierry Denoeux,et al.  RECM: Relational evidential c-means algorithm , 2009, Pattern Recognit. Lett..

[27]  Miin-Shen Yang Convergence properties of the generalized fuzzy c-means clustering algorithms , 1993 .

[28]  Thierry Denoeux,et al.  ECM: An evidential version of the fuzzy c , 2008, Pattern Recognit..

[29]  M. Roubens Pattern classification problems and fuzzy sets , 1978 .

[30]  James C. Bezdek,et al.  A mixed c-means clustering model , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[31]  Zhimin Wang,et al.  Adaptive spatial information-theoretic clustering for image segmentation , 2009, Pattern Recognit..

[32]  James C. Bezdek,et al.  Relational duals of the c-means clustering algorithms , 1989, Pattern Recognit..

[33]  Tong Zhao,et al.  K-means clustering-based data detection and symbol-timing recovery for burst-mode optical receiver , 2006, IEEE Transactions on Communications.

[34]  Yanhui Guo,et al.  Modified neutrosophic approach to color image segmentation , 2013, J. Electronic Imaging.

[35]  Sukanto Bhattacharya,et al.  A short note on financial data set detection using neutrosophic probability , 2001 .

[36]  James C. Bezdek,et al.  Nerf c-means: Non-Euclidean relational fuzzy clustering , 1994, Pattern Recognit..

[37]  Jian Yu,et al.  Analysis of the weighting exponent in the FCM , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Pierre Loonis,et al.  The fuzzy c+2-means: solving the ambiguity rejection in clustering , 2000, Pattern Recognit..

[39]  Sankar K. Pal,et al.  Fuzzy tools for the management of uncertainty in pattern recognition, image analysis, vision and expert systems , 1991 .

[40]  Palma Blonda,et al.  A survey of fuzzy clustering algorithms for pattern recognition. II , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[41]  Florentin Smarandache,et al.  A unifying field in logics : neutrosophic logic : neutrosophy, neutrosophic set, neutrosophic probability , 2020 .

[42]  M. P. Windham Numerical classification of proximity data with assignment measures , 1985 .

[43]  Yanhui Guo,et al.  New neutrosophic approach to image segmentation , 2009, Pattern Recognit..

[44]  Yanhui Guo,et al.  Color texture image segmentation based on neutrosophic set and wavelet transformation , 2011, Comput. Vis. Image Underst..

[45]  Layachi Bentabet,et al.  Automatic determination of mass functions in Dempster-Shafer theory using fuzzy-C-means and spatial neighborhood information for image segmentation , 2002 .