Classification of Hyperspectral Images Using Kernel Fully Constrained Least Squares

As a widely used classifier, sparse representation classification (SRC) has shown its good performance for hyperspectral image classification. Recent works have highlighted that it is the collaborative representation mechanism under SRC that makes SRC a highly effective technique for classification purposes. If the dimensionality and the discrimination capacity of a test pixel is high, other norms (e.g., l 2 -norm) can be used to regularize the coding coefficients, except for the sparsity l 1 -norm. In this paper, we show that in the kernel space the nonnegative constraint can also play the same role, and thus suggest the investigation of kernel fully constrained least squares (KFCLS) for hyperspectral image classification. Furthermore, in order to improve the classification performance of KFCLS by incorporating spatial-spectral information, we investigate two kinds of spatial-spectral methods using two regularization strategies: (1) the coefficient-level regularization strategy, and (2) the class-level regularization strategy. Experimental results conducted on four real hyperspectral images demonstrate the effectiveness of the proposed KFCLS, and show which way to incorporate spatial-spectral information efficiently in the regularization framework.

[1]  Rama Chellappa,et al.  Kernel fully constrained least squares abundance estimates , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Jon Atli Benediktsson,et al.  Extended Random Walker-Based Classification of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  David Zhang,et al.  Relaxed collaborative representation for pattern classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[6]  Hao Wu,et al.  Superpixels for Spatially Reinforced Bayesian Classification of Hyperspectral Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[7]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Fikret S. Gürgen,et al.  Ensemble canonical correlation analysis , 2013, Applied Intelligence.

[9]  Liangpei Zhang,et al.  Hyperspectral Image Classification by Nonlocal Joint Collaborative Representation With a Locally Adaptive Dictionary , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  J. Benediktsson,et al.  Remotely Sensed Image Classification Using Sparse Representations of Morphological Attribute Profiles , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Gjlles Aubert,et al.  Mathematical problems in image processing , 2001 .

[14]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[15]  Yiming Pi,et al.  Polarimetric Contextual Classification of PolSAR Images Using Sparse Representation and Superpixels , 2014, Remote. Sens..

[16]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[17]  Vassilios S. Vassiliadis,et al.  Sparse solution of nonnegative least squares problems with applications in the construction of probabilistic Boolean networks , 2015, Numer. Linear Algebra Appl..

[18]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[19]  Jon Atli Benediktsson,et al.  Multiple Feature Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Yufeng Chen,et al.  Spatial-Spectral Graph Regularized Kernel Sparse Representation for Hyperspectral Image Classification , 2017, ISPRS Int. J. Geo Inf..

[21]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[24]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Huchuan Lu,et al.  Kernel collaborative face recognition , 2015, Pattern Recognit..

[27]  Qi Li,et al.  Hyperspectral Imagery Classification Using Sparse Representations of Convolutional Neural Network Features , 2016, Remote. Sens..

[28]  Qian Du,et al.  Joint Within-Class Collaborative Representation for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Shutao Li,et al.  Multiscale Superpixel-Based Sparse Representation for Hyperspectral Image Classification , 2017, Remote. Sens..

[30]  Yuan Yan Tang,et al.  Hyperspectral Image Classification Based on Regularized Sparse Representation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Matthias Hein,et al.  Sparse recovery by thresholded non-negative least squares , 2011, NIPS.

[32]  Liang Xiao,et al.  Superpixel-guided multiscale kernel collaborative representation for hyperspectral image classification , 2016 .

[33]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[34]  David Zhang,et al.  Collaborative Representation based Classification for Face Recognition , 2012, ArXiv.

[35]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[36]  Liang-Tien Chia,et al.  Kernel Sparse Representation for Image Classification and Face Recognition , 2010, ECCV.

[37]  Jun Li,et al.  GPU Parallel Implementation of Spatially Adaptive Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Fang Liu,et al.  Hyperspectral Image Classification by Spatial–Spectral Derivative-Aided Kernel Joint Sparse Representation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Shaoguang Zhou,et al.  Discriminative Sparse Representation for Hyperspectral Image Classification: A Semi-Supervised Perspective , 2017, Remote. Sens..

[40]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[41]  Simon Foucart,et al.  Sparse Recovery by Means of Nonnegative Least Squares , 2014, IEEE Signal Processing Letters.

[42]  Liang Xiao,et al.  Hyperspectral Image Classification Using Kernel Sparse Representation and Semilocal Spatial Graph Regularization , 2014, IEEE Geoscience and Remote Sensing Letters.

[43]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Junjun Jiang,et al.  Multiscale Union Regions Adaptive Sparse Representation for Hyperspectral Image Classification , 2017, Remote. Sens..

[45]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression With Active Learning , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Jian Yang,et al.  Beyond sparsity: The role of L1-optimizer in pattern classification , 2012, Pattern Recognit..

[47]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[48]  Chein-I Chang,et al.  Fully constrained least squares linear spectral mixture analysis method for material quantification in hyperspectral imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[49]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Lorenzo Bruzzone,et al.  Extended profiles with morphological attribute filters for the analysis of hyperspectral data , 2010 .

[52]  Hongyan Zhang,et al.  Column-generation kernel nonlocal joint collaborative representation for hyperspectral image classification , 2014 .

[53]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[54]  Jun Li,et al.  Tensor Block-Sparsity Based Representation for Spectral-Spatial Hyperspectral Image Classification , 2016, Remote. Sens..

[55]  Qian Du,et al.  Kernel Collaborative Representation With Tikhonov Regularization for Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[56]  José M. Bioucas-Dias,et al.  Alternating direction algorithms for constrained sparse regression: Application to hyperspectral unmixing , 2010, 2010 2nd Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[57]  Liang Xiao,et al.  Spatial-Spectral Kernel Sparse Representation for Hyperspectral Image Classification , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[58]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[59]  Qian Du,et al.  Robust Hyperspectral Image Classification by Multi-Layer Spatial-Spectral Sparse Representations , 2016, Remote. Sens..

[60]  Antonio J. Plaza,et al.  Anomaly Detection in Hyperspectral Images Based on Low-Rank and Sparse Representation , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[61]  Antonio J. Plaza,et al.  Probabilistic-Kernel Collaborative Representation for Spatial–Spectral Hyperspectral Image Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[64]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[65]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.