Superpixel-Based Extended Random Walker for Hyperspectral Image Classification

In this paper, a novel SuperPixel-based Extended Random Walker (SPERW) classification method for hyperspectral images is proposed that consists of three main steps. First, a multiscale segmentation algorithm is adopted to generate many superpixels, each of which represents a homogeneous region of adaptive shape and size. Then, a new weighted graph is constructed based on the superpixels in which the nodes correspond to the superpixels and the edges correspond to the links connecting two adjacent superpixels. Each edge has a weight that defines the similarity between the two superpixels. Second, a widely used pixelwise classifier, i.e., the support vector machine, is adopted to obtain classification probability maps for a hyperspectral image, which are then used to approximate the prior probabilities of the superpixels. Finally, the obtained prior probability maps of the superpixels are optimized by using the Extended Random Walker (ERW) algorithm, which encodes the spatial information both among and within the superpixels of the hyperspectral image in a weighted graph. Compared with the spectrum of a single pixel, the spectrum of a superpixel is more stable and less affected by noise; therefore, superpixels are more appropriate for adoption as the basic elements in the hyperspectral image classification. Because the spectral correlation between pixels within the same superpixel and the spatial correlation among adjacent superpixels are both well considered in the ERW-based global optimization framework, the proposed method shows high classification accuracy on four widely used real hyperspectral data sets even when the number of training samples is relatively small.

[1]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Images Using Minimum Spanning Forest Grown From Automatically Selected Markers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[2]  H. Ney,et al.  Linear discriminant analysis for improved large vocabulary continuous speech recognition , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Santiago Velasco-Forero,et al.  Improving Hyperspectral Image Classification Using Spatial Preprocessing , 2009, IEEE Geoscience and Remote Sensing Letters.

[4]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[5]  Zhenwei Shi,et al.  MugNet: Deep learning for hyperspectral image classification using limited samples , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[6]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[7]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  D. Böhning Multinomial logistic regression algorithm , 1992 .

[9]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.

[10]  Jon Atli Benediktsson,et al.  Extended Random Walker-Based Classification of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jean-Yves Tourneret,et al.  Bayesian Estimation of Linear Mixtures Using the Normal Compositional Model. Application to Hyperspectral Imagery , 2010, IEEE Transactions on Image Processing.

[12]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Huan Liu,et al.  Sample-screening MKL method via boosting strategy for hyperspectral image classification , 2016, Neurocomputing.

[14]  Saurabh Prasad,et al.  Limitations of Principal Components Analysis for Hyperspectral Target Recognition , 2008, IEEE Geoscience and Remote Sensing Letters.

[15]  Jon Atli Benediktsson,et al.  Class-Specific Sparse Multiple Kernel Learning for Spectral–Spatial Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[17]  Bor-Chen Kuo,et al.  Nonparametric weighted feature extraction for classification , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[19]  Shutao Li,et al.  PCA-Based Edge-Preserving Features for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[21]  Jon Atli Benediktsson,et al.  Random-Walker-Based Collaborative Learning for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Grégoire Mercier,et al.  Classification of hyperspectral images with nonlinear filtering and support vector machines , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[23]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Hao Wu,et al.  An effective feature selection method for hyperspectral image classification based on genetic algorithm and support vector machine , 2011, Knowl. Based Syst..

[25]  Zhenwei Shi,et al.  Multi-objective based spectral unmixing for hyperspectral images , 2017 .

[26]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Ning Zhang,et al.  Hyperspectral Image Classification Based on Nonlinear Spectral–Spatial Network , 2016, IEEE Geoscience and Remote Sensing Letters.

[29]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Xia Xu,et al.  Hierarchical Guidance Filtering-Based Ensemble Classification for Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Yanfeng Gu,et al.  Superpixel-Based Intrinsic Image Decomposition of Hyperspectral Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Jon Atli Benediktsson,et al.  Nonlinear Multiple Kernel Learning With Multiple-Structure-Element Extended Morphological Profiles for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Yanfeng Gu,et al.  Discriminative Multiple Kernel Learning for Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Richard A. Hallett,et al.  Ash decline assessment in emerald ash borer-infested regions: A test of tree-level, hyperspectral technologies , 2008 .

[37]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Leo Grady,et al.  Multilabel random walker image segmentation using prior models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[39]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[40]  Xia Xu,et al.  R-VCANet: A New Deep-Learning-Based Hyperspectral Image Classification Method , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[41]  George A. Lampropoulos,et al.  Hyperspectral Classification Fusion for Classifying Different Military Targets , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[42]  Jon Atli Benediktsson,et al.  Intrinsic Image Decomposition for Feature Extraction of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Kenli Li,et al.  Hyperspectral Anomaly Detection With Attribute and Edge-Preserving Filters , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Jon Atli Benediktsson,et al.  A Novel MKL Model of Integrating LiDAR Data and MSI for Urban Area Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Teferi D. Tsegaye,et al.  Relationship Between Hyperspectral Reflectance, Soil Nitrate-Nitrogen, Cotton Leaf Chlorophyll, and Cotton Yield: A Step Toward Precision Agriculture , 2003 .

[49]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[50]  Yi Ma,et al.  Classification of visible and infrared hyperspectral images based on image segmentation and edge-preserving filtering , 2017 .