Integration of 3-dimensional discrete wavelet transform and Markov random field for hyperspectral image classification

Hyperspectral image (HSI) classification is one of the fundamental tasks in HSI analysis. Recently, many approaches have been extensively studied to improve the classification performance, among which integrating the spatial information underlying HSIs is a simple yet effective way. However, most of the current approaches haven't fully exploited the spatial information prior. They usually consider this prior either in the step of extracting spatial feature before classification or in the step of post-processing label map after classification, while don't integratively employ the prior in both steps, which thus leaves a room for further enhancing their performance. In this paper, we propose a novel spectral-spatial HSI classification method, which fully utilizes the spatial information in both steps. Firstly, the spatial feature is extracted by applying the 3-dimensional discrete wavelet transform (3D-DWT). Secondly, the local spatial correlation of neighboring pixels is modeled using Markov random field (MRF) based on the probabilistic classification map obtained by applying probabilistic support vector machine (SVM) to the extracted 3D-DWT feature in the first step, and then a maximum a posterior (MAP) classification problem can be formulated in a Bayesian perspective. Finally, α-Expansion min-cut-based optimization algorithm is adopted to solve this MAP problem efficiently. Experimental results on two benchmark HSIs show that the proposed method achieves a significant performance gain beyond state-of-the-art methods.

[1]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[2]  Lei Zhang,et al.  Robust Principal Component Analysis with Complex Noise , 2014, ICML.

[3]  Ping Zhong,et al.  Learning Conditional Random Fields for Classification of Hyperspectral Images , 2010, IEEE Transactions on Image Processing.

[4]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[5]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Yang Xu,et al.  Spectral-Spatial Classification of Hyperspectral Image Based on Low-Rank Decomposition , 2015, IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens..

[7]  Joydeep Ghosh,et al.  Investigation of the random forest framework for classification of hyperspectral data , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Trac D. Tran,et al.  Structured Priors for Sparse-Representation-Based Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[10]  Hong Li,et al.  Hyperspectral Image Classification Using Functional Data Analysis , 2014, IEEE Transactions on Cybernetics.

[11]  Hamid R. Rabiee,et al.  Spatial-Aware Dictionary Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Jon Atli Benediktsson,et al.  Land-Cover Mapping by Markov Modeling of Spatial–Contextual Information in Very-High-Resolution Remote Sensing Images , 2013, Proceedings of the IEEE.

[13]  Michele Volpi,et al.  Semi-supervised multiview embedding for hyperspectral data classification , 2014, Neurocomputing.

[14]  Lei Zhang,et al.  A Cyclic Weighted Median Method for L1 Low-Rank Matrix Factorization with Missing Entries , 2013, AAAI.

[15]  Yao Wang,et al.  Low-Rank Matrix Factorization under General Mixture Noise Distributions , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[16]  Qingquan Li,et al.  Spectral–Spatial Hyperspectral Image Classification Using $\ell_{1/2}$ Regularized Low-Rank Representation and Sparse Representation-Based Graph Cuts , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[17]  Deyu Meng,et al.  Robust Matrix Factorization with Unknown Noise , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Ye Zhang,et al.  Multiple Kernel Learning via Low-Rank Nonnegative Matrix Factorization for Classification of Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Amaury Lendasse,et al.  Extreme learning machines for soybean classification in remote sensing hyperspectral images , 2014, Neurocomputing.

[20]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Lei Zhang,et al.  Multispectral Images Denoising by Intrinsic Tensor Sparsity Regularization , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Chunhui Zhao,et al.  Hyperspectral Image Processing , 2015 .

[24]  Houbing Song,et al.  Feature selection and multiple kernel boosting framework based on PSO with mutation mechanism for hyperspectral classification , 2017, Neurocomputing.

[25]  Yi Yang,et al.  Decomposable Nonlocal Tensor Dictionary Learning for Multispectral Image Denoising , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Liangpei Zhang,et al.  A Nonlocal Weighted Joint Sparse Representation Classification Method for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Xuelong Li,et al.  Spectral-Spatial Constraint Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[28]  David A. Landgrebe,et al.  Signal Theory Methods in Multispectral Remote Sensing , 2003 .

[29]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[30]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[31]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[32]  D. Böhning Multinomial logistic regression algorithm , 1992 .

[33]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[34]  Shuang Wang,et al.  Weighted multifeature hyperspectral image classification via kernel joint sparse representation , 2016, Neurocomputing.

[35]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[36]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Bodo Rosenhahn,et al.  Integration of Gaussian process and MRF for hyperspectral image classification , 2015, 2015 Joint Urban Remote Sensing Event (JURSE).

[38]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[39]  Liu Chun-Lin,et al.  A Tutorial of the Wavelet Transform , 2010 .

[40]  Aakanksha Rana,et al.  Graph-cut-based model for spectral-spatial classification of hyperspectral images , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[41]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[42]  Jun Zhou,et al.  Hyperspectral Image Classification Based on Structured Sparse Logistic Regression and Three-Dimensional Wavelet Texture Features , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Magdy A. Bayoumi,et al.  Three-dimensional discrete wavelet transform architectures , 2002, IEEE Trans. Signal Process..

[44]  Layne T. Watson,et al.  An Adaptive Noise-Filtering Algorithm for AVIRIS Data With Implications for Classification Accuracy , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Antonio J. Plaza,et al.  Spectral-spatial classification for hyperspectral data using SVM and subspace MLR , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[46]  Yi Shen,et al.  Low-rank group inspired dictionary learning for hyperspectral image classification , 2016, Signal Processing.