Particle swarm optimization of kernel-based fuzzy c-means for hyperspectral data clustering

Abstract. Hyperspectral data classification using supervised approaches, in general, and the statistical algorithms, in particular, need high quantity and quality training data. However, these limitations, and the high dimensionality of these data, are the most important problems for using the supervised algorithms. As a solution, unsupervised or clustering algorithms can be considered to overcome these problems. One of the emerging clustering algorithms that can be used for this purpose is the kernel-based fuzzy c-means (KFCM), which has been developed by kernelizing the FCM algorithm. Nevertheless, there are some parameters that affect the efficiency of KFCM clustering of hyperspectral data. These parameters include kernel parameters, initial cluster centers, and the number of spectral bands. To address these problems, two new algorithms are developed. In these algorithms, the particle swarm optimization method is employed to optimize the KFCM with respect to these parameters. The first algorithm is designed to optimize the KFCM with respect to kernel parameters and initial cluster centers, while the second one selects the optimum discriminative subset of bands and the former parameters as well. The evaluations of the results of experiments show that the proposed algorithms are more efficient than the standard k-means and FCM algorithms for clustering hyperspectral remotely sensed data.

[1]  Lorenzo Bruzzone,et al.  A semilabeled-sample-driven bagging technique for ill-posed classification problems , 2005, IEEE Geoscience and Remote Sensing Letters.

[2]  Tülay Yildirim,et al.  Unsupervised classification of hyperspectral-image data using fuzzy approaches that spatially exploit membership relations , 2008, IEEE Geoscience and Remote Sensing Letters.

[3]  Thomas A. Runkler Ant colony optimization of clustering models , 2005, Int. J. Intell. Syst..

[4]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Gökhan Bilgin,et al.  Segmentation of Hyperspectral Images via Subtractive Clustering and Cluster Validation Using One-Class Support Vector Machines , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Song-can Chen,et al.  Kernel-based fuzzy and possibilistic c-means clustering , 2003 .

[7]  Chein-I Chang,et al.  Estimation of number of spectrally distinct signal sources in hyperspectral imagery , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[9]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[10]  Russell G. Congalton,et al.  Basic Analysis Techniques , 2008 .

[11]  Dao-Qiang Zhang,et al.  A novel kernelized fuzzy C-means algorithm with application in medical image segmentation , 2004, Artif. Intell. Medicine.

[12]  James C. Bezdek,et al.  Optimization of fuzzy clustering criteria using genetic algorithms , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[13]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[14]  Farhad Samadzadegan,et al.  Fuzzy clustering of hyperspectral data based on particle swarm optimization , 2011, 2011 3rd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[15]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Csaba Legány,et al.  Cluster validity measurement techniques , 2006 .

[17]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[18]  Tieli Sun,et al.  Particle Swarm Optimization and Differential Evolution in Fuzzy Clustering , 2008, ICONIP.

[19]  Alexander J. Smola,et al.  Hyperkernels , 2002, NIPS.

[20]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[21]  M. Crawford,et al.  Results from the EO‐1 experiment—A comparative study of Earth Observing‐1 Advanced Land Imager (ALI) and Landsat ETM+ data for land cover mapping in the Okavango Delta, Botswana , 2005 .

[22]  Chein-I Chang,et al.  Constrained band selection for hyperspectral imagery , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Thomas A. Runkler,et al.  Fuzzy Clustering by Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[24]  James M. Keller,et al.  Fuzzy Models and Algorithms for Pattern Recognition and Image Processing , 1999 .

[25]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[26]  Hsiang-Chuan Liu,et al.  A Novel Fuzzy C-Means Method for Hyperspectral Image Classification , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[27]  Gabriele Moser,et al.  Feature Reduction for Classification Purpose , 2006 .

[28]  Doheon Lee,et al.  Evaluation of the performance of clustering algorithms in kernel-induced feature space , 2005, Pattern Recognit..

[29]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Kohei Inoue,et al.  Robust Kernel Fuzzy Clustering , 2005, FSKD.

[31]  Melba M. Crawford,et al.  Hierarchical clustering approach for unsupervised image classification of hyperspectral data , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[32]  B. Mojaradia,et al.  A NOVEL BAND SELECTION METHOD FOR HYPERSPECTRAL DATA ANALYSIS , 2008 .

[33]  Witold Pedrycz,et al.  Kernel-based fuzzy clustering and fuzzy clustering: A comparative experimental study , 2010, Fuzzy Sets Syst..

[34]  Lorenzo Bruzzone,et al.  Semisupervised Classification of Hyperspectral Images by SVMs Optimized in the Primal , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Rui Xu,et al.  Survey of clustering algorithms , 2005, IEEE Transactions on Neural Networks.

[36]  Lorenzo Bruzzone,et al.  A Support Vector Domain Description Approach to Supervised Classification of Remote Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Mohammad Mehdi Ebadzadeh,et al.  Material Classification of Hyperspectral Images Using Unsupervised Fuzzy Clustering Methods , 2007, 2007 Third International IEEE Conference on Signal-Image Technologies and Internet-Based System.

[38]  Shi Yu-feng,et al.  Remote sensing image classification and recognition based on KFCM , 2010, 2010 5th International Conference on Computer Science & Education.

[39]  Liu Wei Hyperspectral Remote Sensing Image Classification Based on Kernel Fisher Discriminant Analysis , 2008 .

[40]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[41]  Dao-Qiang Zhang,et al.  Clustering Incomplete Data Using Kernel-Based Fuzzy C-means Algorithm , 2003, Neural Processing Letters.

[42]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[43]  X. Jia,et al.  Hyperspectral Data Representation , 2006 .

[44]  Mark A. Girolami,et al.  Mercer kernel-based clustering in feature space , 2002, IEEE Trans. Neural Networks.

[45]  Okan K. Ersoy,et al.  Kent Mixture Model for Hyperspectral Clustering via Cosine Pixel Coordinates on Spherical Manifolds , 2011 .

[46]  Farid Melgani,et al.  Clustering of Hyperspectral Images Based on Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Geoscience and Remote Sensing.