Multifeature Hyperspectral Image Classification With Local and Nonlocal Spatial Information via Markov Random Field in Semantic Space

Hyperspectral images (HSIs) provide invaluable information in both spectral and spatial domains for image classification tasks. In this paper, we use semantic representation as a middle-level feature to describe image pixels’ characteristics. Deriving effective semantic representation is critical for achieving good classification performance. Since different image descriptors depict characteristics from different perspectives, combining multiple features in the same semantic space makes semantic representation more meaningful. First, a probabilistic support vector machine is used to generate semantic representation-based multifeatures. In order to derive better semantic representation, we introduce a new adaptive spatial regularizer that well exploits the local spatial information, while a nonlocal regularizer is also used to search for global patch-pair similarities in the whole image. We combine multiple features with local and nonlocal spatial constraints using an extended Markov random field model in the semantic space. Experimental results on three hyperspectral data sets show that the proposed method provides better performance than several state-of-the-art techniques in terms of region uniformity, overall accuracy, average accuracy, and Kappa statistics.

[1]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[2]  Maoguo Gong,et al.  Hyperspectral Image Classification Based on Nonlocal Means With a Novel Class-Relativity Measurement , 2014, IEEE Geoscience and Remote Sensing Letters.

[3]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[4]  Liangpei Zhang,et al.  Comparison of Vector Stacking, Multi-SVMs Fuzzy Output, and Multi-SVMs Voting Methods for Multiscale VHR Urban Mapping , 2010, IEEE Geoscience and Remote Sensing Letters.

[5]  Glenn Healey,et al.  Hyperspectral texture recognition using a multiscale opponent representation , 2003, IEEE Trans. Geosci. Remote. Sens..

[6]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[7]  Xiangrong Zhang,et al.  Semisupervised Dimensionality Reduction of Hyperspectral Images via Local Scaling Cut Criterion , 2013, IEEE Geoscience and Remote Sensing Letters.

[8]  Nuno Vasconcelos,et al.  Scene Recognition on the Semantic Manifold , 2012, ECCV.

[9]  Glenn Healey,et al.  Hyperspectral Region Classification Using a Three-Dimensional Gabor Filterbank , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Shuang Wang,et al.  Weighted multifeature hyperspectral image classification via kernel joint sparse representation , 2016, Neurocomputing.

[12]  Giles M. Foody,et al.  Feature Selection for Classification of Hyperspectral Data by SVM , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Luis Herranz,et al.  Joint multi-feature spatial context for scene recognition in the semantic manifold , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Stan Z. Li.  Markov Random Field Modeling in Image Analysis , 2009, Advances in Pattern Recognition.

[17]  Hassan Ghassemian,et al.  Integrating Hierarchical Segmentation Maps With MRF Prior for Classification of Hyperspectral Images in a Bayesian Framework , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[19]  Jun Li,et al.  A Novel MRF-Based Multifeature Fusion for Classification of Remote Sensing Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[21]  Lianru Gao,et al.  Adaptive Markov Random Field Approach for Classification of Hyperspectral Imagery , 2011, IEEE Geoscience and Remote Sensing Letters.

[22]  Jon Atli Benediktsson,et al.  A multiple classifier approach for spectral-spatial classification of hyperspectral data , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[23]  Jon Atli Benediktsson,et al.  Fusion of Support Vector Machines for Classification of Multisensor Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[24]  S. Prasher,et al.  Classification of hyperspectral data by decision trees and artificial neural networks to identify weed stress and nitrogen status of corn , 2003 .

[25]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[26]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[27]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[28]  Liang Xiao,et al.  Supervised Spectral–Spatial Hyperspectral Image Classification With Weighted Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Gabriele Moser,et al.  Combining Support Vector Machines and Markov Random Fields in an Integrated Framework for Contextual Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Nasser M. Nasrabadi,et al.  Automated Hyperspectral Cueing for Civilian Search and Rescue , 2009, Proceedings of the IEEE.

[32]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Classification Using Soft Sparse Multinomial Logistic Regression , 2013, IEEE Geoscience and Remote Sensing Letters.

[33]  Qiang Song,et al.  Spectral–Spatial Feature Learning Using Cluster-Based Group Sparse Coding for Hyperspectral Image Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Jon Atli Benediktsson,et al.  The spectral-spatial classification of hyperspectral images based on Hidden Markov Random Field and its Expectation-Maximization , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[35]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[36]  Liangpei Zhang,et al.  A Nonlocal Weighted Joint Sparse Representation Classification Method for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Ribana Roscher,et al.  Superpixel-based classification of hyperspectral data using sparse representation and conditional random fields , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[38]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[39]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Jason Weston,et al.  Semisupervised Neural Networks for Efficient Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Liangpei Zhang,et al.  Non-Local Sparse Unmixing for Hyperspectral Remote Sensing Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Xi Chen,et al.  Text classification with kernels on the multinomial manifold , 2005, SIGIR '05.

[43]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Jon Atli Benediktsson,et al.  Adaptive pixel neighborhood definition for the classification of hyperspectral images with support vector machines and composite kernel , 2008, 2008 15th IEEE International Conference on Image Processing.

[45]  Minchao Ye,et al.  Hyperspectral Imagery Restoration Using Nonlocal Spectral-Spatial Structured Sparse Representation With Noise Estimation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[46]  Liangpei Zhang,et al.  Efficient Superpixel-Level Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[48]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.