Generalization rules for the suppressed fuzzy c-means clustering algorithm

Intending to achieve an algorithm characterized by the quick convergence of hard c-means (HCM) and finer partitions of fuzzy c-means (FCM), suppressed fuzzy c-means (s-FCM) clustering was designed to augment the gap between high and low values of the fuzzy membership functions. Suppression is produced via modifying the FCM iteration by creating a competition among clusters: for each input vector, lower degrees of membership are proportionally reduced, being multiplied by a previously set constant suppression rate, while the largest fuzzy membership grows to maintain the probabilistic constraint. Even though so far it was not treated as an optimal algorithm, it was employed in a series of applications, and reported to be accurate and efficient in various clustering problems. In this paper we introduce some generalized formulations of the suppression rule, leading to an infinite number of new clustering algorithms. Further on, we identify the close relation between s-FCM clustering models and the so-called FCM algorithm with generalized improved partition (GIFP-FCM). Finally we reveal the constraints under which the generalized s-FCM clustering models minimize the objective function of GIFP-FCM, allowing us to call our suppressed clustering models optimal. Based on a large amount of numerical tests performed in multidimensional environment, several generalized forms of suppression proved to give more accurate partitions than earlier solutions, needing significantly less iterations than the conventional FCM.

[1]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  James C. Bezdek,et al.  Extending fuzzy and probabilistic clustering to very large data sets , 2006, Comput. Stat. Data Anal..

[3]  Qian Wang,et al.  The range of the value for the fuzzifier of the fuzzy c-means algorithm , 2012, Pattern Recognit. Lett..

[4]  Miin-Shen Yang,et al.  Parameter selection for suppressed fuzzy c-means with an application to MRI segmentation , 2006, Pattern Recognit. Lett..

[5]  I. Burhan Türksen,et al.  Increasing accuracy of two-class pattern recognition with enhanced fuzzy functions , 2009, Expert Syst. Appl..

[6]  James C. Bezdek,et al.  Norm-induced shell-prototypes (NISP) clustering , 1995, Neural Parallel Sci. Comput..

[7]  Myeongsu Kang,et al.  A Hybrid Technique for Medical Image Segmentation , 2012, Journal of biomedicine & biotechnology.

[8]  László Szilágyi,et al.  Lessons to learn from a mistaken optimization , 2014, Pattern Recognit. Lett..

[9]  Li Xiang Jun,et al.  The Application of Fuzzy C-Means Clustering in Macro-Economic Forecast , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[10]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[11]  Adel M. Alimi,et al.  Improved Modified Suppressed Fuzzy C-Means , 2010, 2010 2nd International Conference on Image Processing Theory, Tools and Applications.

[12]  Miin-Shen Yang,et al.  Suppressed fuzzy-soft learning vector quantization for MRI segmentation , 2011, Artif. Intell. Medicine.

[13]  Frank Hoeppner,et al.  Fuzzy shell clustering algorithms in image processing: fuzzy C-rectangular and 2-rectangular shells , 1997, IEEE Trans. Fuzzy Syst..

[14]  Yen-Chang Chang,et al.  A Modified Fuzzy C-Means Algorithm for Differentiation in MRI of Ophthalmology , 2006, MDAI.

[15]  László Szilágyi,et al.  Analytical and Numerical Evaluation of the Suppressed Fuzzy C-Means Algorithm , 2008, MDAI.

[16]  László Szilágyi,et al.  Analytical and numerical evaluation of the suppressed fuzzy c-means algorithm: a study on the competition in c-means clustering models , 2010, Soft Comput..

[17]  Weixin Xie,et al.  Suppressed fuzzy c-means clustering algorithm , 2003, Pattern Recognit. Lett..

[18]  Korris Fu-Lai Chung,et al.  Generalized Fuzzy C-Means Clustering Algorithm With Improved Fuzzy Partitions , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  John F. Kolen,et al.  Reducing the time complexity of the fuzzy c-means algorithm , 2002, IEEE Trans. Fuzzy Syst..

[20]  Stelios Krinidis,et al.  A Robust Fuzzy Local Information C-Means Clustering Algorithm , 2010, IEEE Transactions on Image Processing.

[21]  Lawrence O. Hall,et al.  Fast fuzzy clustering , 1998, Fuzzy Sets Syst..

[22]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[23]  Hichem Frigui,et al.  The fuzzy c spherical shells algorithm: A new approach , 1992, IEEE Trans. Neural Networks.

[24]  James C. Bezdek,et al.  Efficient Implementation of the Fuzzy c-Means Clustering Algorithms , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Ajith Abraham,et al.  Fuzzy C-means and fuzzy swarm for fuzzy clustering problem , 2011, Expert Syst. Appl..

[26]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[27]  S.M. Szilagyi,et al.  MR brain image segmentation using an enhanced fuzzy C-means algorithm , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[28]  Andreas Philipp,et al.  Classifications of Atmospheric Circulation Patterns , 2008, Annals of the New York Academy of Sciences.

[29]  Rajesh N. Davé,et al.  Adaptive fuzzy c-shells clustering and detection of ellipses , 1992, IEEE Trans. Neural Networks.

[30]  Miin-Shen Yang,et al.  A Robust Kernel-Based Fuzzy C-Means Algorithm by Incorporating Suppressed and Magnified Membership for MRI Image Segmentation , 2012, AICI.

[31]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[32]  Lawrence O. Hall,et al.  Fast Accurate Fuzzy Clustering through Data Reduction , 2003 .

[33]  Enrique H. Ruspini,et al.  A New Approach to Clustering , 1969, Inf. Control..

[34]  Marimuthu Palaniswami,et al.  Fuzzy c-Means Algorithms for Very Large Data , 2012, IEEE Transactions on Fuzzy Systems.

[35]  Frank Klawonn,et al.  Improved fuzzy partitions for fuzzy regression models , 2003, Int. J. Approx. Reason..

[36]  José Luis Martín,et al.  Implementation of a modified Fuzzy C-Means clustering algorithm for real-time applications , 2005, Microprocess. Microsystems.

[37]  KrishnapuramR.,et al.  The fuzzy c spherical shells algorithm , 1992 .

[38]  Mohamed S. Kamel,et al.  New algorithms for solving the fuzzy clustering problem , 1994, Pattern Recognit..

[39]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[40]  I. Burhan Türksen,et al.  Enhanced Fuzzy System Models With Improved Fuzzy Clustering Algorithm , 2008, IEEE Transactions on Fuzzy Systems.

[41]  James C. Bezdek,et al.  On cluster validity for the fuzzy c-means model , 1995, IEEE Trans. Fuzzy Syst..