Bootstrapping approach to feature-weight selection in fuzzy c-means algorithms with an application in color image segmentation

The fuzzy c-means (FCM) algorithm is a popular fuzzy clustering method. It is known that an appropriate assignment to feature weights can improve the performance of FCM. In this paper, we use the bootstrap method proposed by Efron [Efron, B., 1979. Bootstrap methods: Another look at the jackknife. Ann. Statist. 7, 1-26] to select feature weights based on statistical variations in the data. It is simple to compute and interpret for feature-weights selection. Compared with the feature weights proposed by Wang et al. [Wang, X.Z., Wang, Y.D., Wang, L.J., 2004. Improving fuzzy c-means clustering based on feature-weight learning. Pattern Recognition Lett. 25, 1123-1132], Modha and Spangler [Modha, D.S., Spangler, W.S., 2003. Feature weighting in k-means clustering. Machine Learn. 52, 217-237], Pal et al. [Pal, S.K., De, R.K., Basak, J., 2000. Unsupervised feature evaluation: A neuro-fuzzy approach. IEEE Trans. Neural Networks 11, 366-376] and Basak et al. [Basak, J., De, R.K., Pal, S.K., 1998. Unsupervised feature selection using a neuro-fuzzy approach. Pattern Recognition Lett. 19, 997-1006] we find that the proposed method provides a better clustering performance for Iris data and several simulated datasets based on error rate criterion and also performs well in color image segmentation according to Liu and Yang's [Liu, J., Yang, Y.H., 1994. Multiresolution color image segmentation technique. IEEE Trans. Pattern Anal. Machine Intell. 16, 689-700] evaluation function.

[1]  Doheon Lee,et al.  A novel initialization scheme for the fuzzy c-means algorithm for color clustering , 2004, Pattern Recognit. Lett..

[2]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[3]  Sankar K. Pal,et al.  Unsupervised feature evaluation: a neuro-fuzzy approach , 2000, IEEE Trans. Neural Networks Learn. Syst..

[4]  Miin-Shen Yang A survey of fuzzy clustering , 1993 .

[5]  V. J. Rayward-Smith,et al.  Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition , 1999 .

[6]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[7]  Jian Yu,et al.  Analysis of the weighting exponent in the FCM , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[8]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[9]  Sankar K. Pal,et al.  Unsupervised feature selection using a neuro-fuzzy approach , 1998, Pattern Recognit. Lett..

[10]  W. Scott Spangler,et al.  Feature Weighting in k-Means Clustering , 2003, Machine Learning.

[11]  Yadong Wang,et al.  Improving fuzzy c-means clustering based on feature-weight learning , 2004, Pattern Recognit. Lett..

[12]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[13]  Jian Yu,et al.  Optimality test for generalized FCM and its application to parameter selection , 2005, IEEE Transactions on Fuzzy Systems.

[14]  Yee-Hong Yang,et al.  Multiresolution Color Image Segmentation , 1994, IEEE Trans. Pattern Anal. Mach. Intell..