Shadowed C-means clustering based on approximated feature space

The random Fourier Features method has been found very effective in approximating the kernel functions. Our former studies show that through a mixing mechanism of the feature space formed by random Fourier features and certain linear algorithms, the fuzzy clustering results in the approximated feature space are comparable to or even exceed the classical kernel-based algorithms. To increase the robustness of clustering results over outliers, this paper proposes to employ the shadowed C-Means algorithm in the approximated kernel feature space generated by the random Fourier Features method. The experiments compared with traditional fuzzy C-Means algorithm demonstrate the strengths and efficiency of the proposed approach.

[1]  Long Chen,et al.  Approximate fuzzy kernel clustering with random feature mapping and dimension reduction , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[2]  S. Miyamoto Different Objective Functions in Fuzzy c-Means Algorithms and Kernel-Based Clustering , 2011 .

[3]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[4]  Dao-Qiang Zhang,et al.  A novel kernelized fuzzy C-means algorithm with application in medical image segmentation , 2004, Artif. Intell. Medicine.

[5]  Xian'en Qiu,et al.  A sparse fuzzy c-means algorithm based on sparse clustering framework , 2015, Neurocomputing.

[6]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[7]  Jian Yu,et al.  Analysis of the weighting exponent in the FCM , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[8]  Long Chen,et al.  Clustering Algorithm Based on Spatial Shadowed Fuzzy C-means and I-Ching Operators , 2016, Int. J. Fuzzy Syst..

[9]  W. Rudin,et al.  Fourier Analysis on Groups. , 1965 .

[10]  C. L. Philip Chen,et al.  Attribute weight entropy regularization in fuzzy C-means algorithm for feature selection , 2011, Proceedings 2011 International Conference on System Science and Engineering.

[11]  C. L. Philip Chen,et al.  A Multiple-Kernel Fuzzy C-Means Algorithm for Image Segmentation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Pietro Perona,et al.  Self-Tuning Spectral Clustering , 2004, NIPS.

[13]  Long Chen,et al.  New shadowed fuzzy C-means algorithm for image segmentation , 2016, 2016 3rd International Conference on Informative and Cybernetics for Computational Social Systems (ICCSS).

[14]  Ali S. Hadi,et al.  Finding Groups in Data: An Introduction to Chster Analysis , 1991 .

[15]  Lingning Kong,et al.  Fuzzy clustering in high-dimensional approximated feature space , 2016, 2016 International Conference on Fuzzy Theory and Its Applications (iFuzzy).

[16]  Witold Pedrycz,et al.  Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study , 2010, Fuzzy Sets Syst..

[17]  Witold Pedrycz,et al.  Shadowed sets: representing and processing fuzzy sets , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[18]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[19]  Tarald O. Kvålseth,et al.  Entropy and Correlation: Some Comments , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  Long Chen,et al.  Kernel Spatial Shadowed C-Means for Image Segmentation , 2014 .

[21]  Benjamin Recht,et al.  Random Features for Large-Scale Kernel Machines , 2007, NIPS.