Mutually exclusive-KSVD: Learning a discriminative dictionary for hyperspectral image classification

Abstract Sparse representation and dictionary learning methods have been successfully applied in classification of hyperspectral images (HSIs). However, when the number of training data is insufficient which is widely happened in HSI classification, the learned sparse representation is generally insufficient and the corresponding performances would be significantly degraded. To address the above problem, in this paper, we propose a novel dictionary learning method, namely mutually exclusive K-SVD. We construct a mutual exclusion term for the dictionary by decomposing each class of sub-dictionary into positive and negative categories. Therefore, the learned sparse codes not only consider the within-class consistency, but also between-class mutual exclusion, thereby resulting in improved classification performance with limited training samples. Furthermore, in the testing phase, we utilize the multiscale strategy for each pixel instead of pixel-wise coding to make full use of the spatial features of the image and further improve the classification accuracy. Experimental results demonstrate that the proposed algorithm outperforms state-of-the art algorithms in both qualitative and quantitative evaluations.

[1]  Salvatore J. Stolfo,et al.  AdaCost: Misclassification Cost-Sensitive Boosting , 1999, ICML.

[2]  Shuai Hao,et al.  Terrain classification of aerial image based on low-rank recovery and sparse representation , 2017, 2017 20th International Conference on Information Fusion (Fusion).

[3]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[4]  Hossein Nezamabadi-pour,et al.  NPC: Neighbors' progressive competition algorithm for classification of imbalanced data sets , 2017, 2017 3rd Iranian Conference on Intelligent Systems and Signal Processing (ICSPIS).

[5]  Diego Saqui,et al.  Methodology for Band Selection of Hyperspectral Images Using Genetic Algorithms and Gaussian Maximum Likelihood Classifier , 2016, 2016 International Conference on Computational Science and Computational Intelligence (CSCI).

[6]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Lei Zhang,et al.  Projective dictionary pair learning for pattern classification , 2014, NIPS.

[8]  J. Campbell Introduction to remote sensing , 1987 .

[9]  Xiangtao Zheng,et al.  Dimensionality Reduction by Spatial–Spectral Preservation in Selected Bands , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[11]  Robert Ehrlich,et al.  On the extension of fuzzy k-means algorithms for detection of linear clusters , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[12]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification via Multiple-Feature-Based Adaptive Sparse Representation , 2017, IEEE Transactions on Instrumentation and Measurement.

[13]  Jon Atli Benediktsson,et al.  Spectral-spatial hyperspectral classification via shape-adaptive sparse representation , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[14]  Xiangtao Zheng,et al.  Discovering Diverse Subset for Unsupervised Hyperspectral Band Selection , 2017, IEEE Transactions on Image Processing.

[15]  Nitish V. Thakor,et al.  Limb Position Tolerant Pattern Recognition for Myoelectric Prosthesis Control with Adaptive Sparse Representations From Extreme Learning , 2018, IEEE Transactions on Biomedical Engineering.

[16]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[17]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[18]  Meng Yang,et al.  Joint kernel dictionary and classifier learning for sparse coding via locality preserving K-SVD , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[19]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Pedram Ghamisi,et al.  Fusion of Hyperspectral and LiDAR Data Using Sparse and Low-Rank Component Analysis , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[24]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[25]  S. Mallat,et al.  Adaptive greedy approximations , 1997 .

[26]  Wei Li,et al.  Hyperspectral image classification by AdaBoost weighted composite kernel extreme learning machines , 2018, Neurocomputing.

[27]  Alp Erturk,et al.  Sparse unmixing based denoising for hyperspectral images , 2016, IGARSS.

[28]  Qian Du,et al.  Representation-based hyperspectral image classification with imbalanced data , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[29]  Xinbo Gao,et al.  Collaborative learning for hyperspectral image classification , 2018, Neurocomputing.

[30]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[31]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[32]  Yazhou Liu,et al.  Hyperspectral image classification by fusing sparse representation and simple linear iterative clustering , 2015 .

[33]  Shutao Li,et al.  Decision fusion of pixel-level and superpixel-level hyperspectral image classifiers , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[34]  Robert J. Plemmons,et al.  Classification of pixel-level fused hyperspectral and lidar data using deep convolutional neural networks , 2016, 2016 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[35]  Jon Atli Benediktsson,et al.  The spectral-spatial classification of hyperspectral images based on Hidden Markov Random Field and its Expectation-Maximization , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[36]  Vincent Lepetit,et al.  Are sparse representations really relevant for image classification? , 2011, CVPR 2011.