Clustering of Hyperspectral Images with an Ensemble Method Based on Fuzzy C-Means and Markov Random Fields

During the past few years, cluster ensemble methods have been introduced in the area of pattern recognition as a more accurate alternative to individual clustering algorithms as they can provide novel, robust, and stable solutions. The development of these methods is mainly motivated by the success of the combination of supervised classifiers also known as classifier ensemble. In this paper, we propose a novel ensemble method for the classification of hyperspectral images based on Fuzzy c-means (FCM) and Markov random field (MRF) theory. Firstly, in order to construct the ensemble of clustering maps, which call here “partitions”, we run the FCM algorithm several times with different initializations and different subsets of features (spectral bands) selected randomly from the high-dimensional input feature vector characterizing the hyperspectral image. Secondly, since there is no-ground truth information, the class labels contained in each generated partition are symbolic, meaning that the same class of pixels can be labeled with different labels in different partitions of the ensemble. Therefore, an optimal relabeling of the ensemble with respect to a representative partition determined on the basis of the maximum entropy principle is made via a pairwise relabeling procedure. Finally, in the last step, the relabeled partitions are fused by means of an MRF method. The latter exploits two kinds of sources of contextual information: spatial and inter-partition contextual information. During the optimization process, the contributions of the different partitions are controlled through mutual information weights.

[1]  Luísa Castro,et al.  Hierarchical clustering of multispectral images using combined spectral and spatial criteria , 2005, IEEE Geoscience and Remote Sensing Letters.

[2]  Mohamed S. Kamel,et al.  Cumulative Voting Consensus Method for Partitions with Variable Number of Clusters , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Lorenzo Bruzzone,et al.  A genetic expectation-maximization method for unsupervised change detection in multitemporal SAR imagery , 2009 .

[4]  Hong Shi,et al.  Hyperspectral bands reduction based on rough sets and fuzzy C-means clustering , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[5]  Ying Zhang,et al.  Remote sensing image classification based on dot density function weighted FCM clustering algorithm , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[6]  Abel G. Silva-Filho,et al.  Hyperspectral images clustering on reconfigurable hardware using the k-means algorithm , 2003, 16th Symposium on Integrated Circuits and Systems Design, 2003. SBCCI 2003. Proceedings..

[7]  Farid Melgani,et al.  Clustering of Hyperspectral Images Based on Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Gabriela Palacio,et al.  Unsupervised Classification of SAR Images Using Markov Random Fields and ${\cal G}_{I}^{0}$ Model , 2011, IEEE Geoscience and Remote Sensing Letters.

[9]  Ujjwal Maulik,et al.  Multiobjective Genetic Clustering for Pixel Classification in Remote Sensing Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Farid Melgani,et al.  Markovian Fusion Approach to Robust Unsupervised Change Detection in Remotely Sensed Imagery , 2006, IEEE Geoscience and Remote Sensing Letters.

[11]  Mohamed S. Kamel,et al.  On voting-based consensus of cluster ensembles , 2010, Pattern Recognit..

[12]  Liangpei Zhang,et al.  An unsupervised artificial immune classifier for multi/hyperspectral remote sensing imagery , 2006, IEEE Trans. Geosci. Remote. Sens..

[13]  Ana L. N. Fred,et al.  Combining multiple clusterings using evidence accumulation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Dirk H. Hoekman,et al.  Initialization of Markov random field clustering of large remote sensing images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[15]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[16]  Melba M. Crawford,et al.  Hierarchical clustering approach for unsupervised image classification of hyperspectral data , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[17]  Gabriele Moser,et al.  Weight Parameter Optimization by the Ho–Kashyap Algorithm in MRF Models for Supervised Image Classification , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Hong Sun,et al.  A Rapid and Automatic MRF-Based Clustering Method for SAR Images , 2007, IEEE Geoscience and Remote Sensing Letters.

[19]  Sebastiano B. Serpico,et al.  A Markov random field approach to spatio-temporal contextual image classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[20]  Ludmila I. Kuncheva,et al.  Evaluation of Stability of k-Means Cluster Ensembles with Respect to Random Initialization , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Frank Nielsen,et al.  On weighting clustering , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Thomas L. Ainsworth,et al.  Unsupervised classification of polarimetric synthetic aperture Radar images using fuzzy clustering and EM clustering , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Anil K. Jain,et al.  Random field models in image analysis , 1989 .

[24]  Farid Melgani,et al.  Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Tülay Yildirim,et al.  Unsupervised classification of hyperspectral-image data using fuzzy approaches that spatially exploit membership relations , 2008, IEEE Geoscience and Remote Sensing Letters.