Maximum Likelihood Estimation-Based Joint Sparse Representation for the Classification of Hyperspectral Remote Sensing Images

A joint sparse representation (JSR) method has shown superior performance for the classification of hyperspectral images (HSIs). However, it is prone to be affected by outliers in the HSI spatial neighborhood. In order to improve the robustness of JSR, we propose a maximum likelihood estimation (MLE)-based JSR (MLEJSR) model, which replaces the traditional quadratic loss function with an MLE-like estimator for measuring the joint approximation error. The MLE-like estimator is actually a function of coding residuals. Given some priors on the coding residuals, the MLEJSR model can be easily converted to an iteratively reweighted JSR problem. Choosing a reasonable weight function, the effect of inhomogeneous neighboring pixels or outliers can be dramatically reduced. We provide a theoretical analysis of MLEJSR from the viewpoint of recovery error and evaluate its empirical performance on three public hyperspectral data sets. Both the theoretical and experimental results demonstrate the effectiveness of our proposed MLEJSR method, especially in the case of large noise.

[1]  Qian Du,et al.  Classification of hyperspectral urban data using adaptive simultaneous orthogonal matching pursuit , 2014 .

[2]  P. J. Huber Robust Regression: Asymptotics, Conjectures and Monte Carlo , 1973 .

[3]  Weiwei Sun,et al.  Band Selection Using Improved Sparse Subspace Clustering for Hyperspectral Imagery Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Jian Yang,et al.  Robust sparse coding for face recognition , 2011, CVPR 2011.

[5]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[6]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[7]  Yiming Yang,et al.  Modified Logistic Regression: An Approximation to SVM and Its Applications in Large-Scale Text Categorization , 2003, ICML.

[8]  Yicong Zhou,et al.  Ideal Regularized Composite Kernel for Hyperspectral Image Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Ping Zhong,et al.  Jointly Learning the Hybrid CRF and MLR Model for Simultaneous Denoising and Classification of Hyperspectral Imagery , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Ajmal Mian,et al.  Nonparametric Coupled Bayesian Dictionary and Classifier Learning for Hyperspectral Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Qiong Jackson,et al.  Adaptive Bayesian contextual classification based on Markov random fields , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[12]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Fang Liu,et al.  Adaptive Nonlocal Spatial–Spectral Kernel for Hyperspectral Imagery Classification , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Qi Wang,et al.  Hyperspectral Image Classification via Multitask Joint Sparse Representation and Stepwise MRF Optimization , 2016, IEEE Transactions on Cybernetics.

[15]  Yicong Zhou,et al.  Region-Kernel-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Gang Yang,et al.  A Sparse and Low-Rank Near-Isometric Linear Embedding Method for Feature Extraction in Hyperspectral Imagery Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[17]  MaYi,et al.  Dense error correction via l1-minimization , 2010 .

[18]  J. Benediktsson,et al.  Remotely Sensed Image Classification Using Sparse Representations of Morphological Attribute Profiles , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Qian Du,et al.  Self-Paced Joint Sparse Representation for the Classification of Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Jiayi Ma,et al.  Hyperspectral Image Classification With Robust Sparse Representation , 2016, IEEE Geoscience and Remote Sensing Letters.

[24]  Trac D. Tran,et al.  Structured Priors for Sparse-Representation-Based Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[25]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Xuelong Li,et al.  A Hybrid Sparsity and Distance-Based Discrimination Detector for Hyperspectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Fuchun Sun,et al.  A Fast and Robust Sparse Approach for Hyperspectral Data Classification Using a Few Labeled Samples , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Saurabh Prasad,et al.  Class-Dependent Sparse Representation Classifier for Robust Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[31]  Liangpei Zhang,et al.  An SVM Ensemble Approach Combining Spectral, Structural, and Semantic Features for the Classification of High-Resolution Remotely Sensed Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[33]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Yuan Yan Tang,et al.  Manifold-based Sparse Representation for hyperspectral Image Classification , 2016, Handbook of Pattern Recognition and Computer Vision.

[35]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[36]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[37]  Liangpei Zhang,et al.  A Nonlocal Weighted Joint Sparse Representation Classification Method for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Liangpei Zhang,et al.  Joint Collaborative Representation With Multitask Learning for Hyperspectral Image Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Charles V. Stewart,et al.  Robust Parameter Estimation in Computer Vision , 1999, SIAM Rev..

[40]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Yuan Yan Tang,et al.  Hyperspectral Image Classification Based on Regularized Sparse Representation , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Hamid R. Rabiee,et al.  Spatial-Aware Dictionary Learning for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Jiangtao Peng,et al.  Nearest Regularized Joint Sparse Representation for Hyperspectral Image Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[45]  Qian Du,et al.  Robust Joint Sparse Representation Based on Maximum Correntropy Criterion for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Thomas S. Huang,et al.  Spatial–Spectral Classification of Hyperspectral Images Using Discriminative Dictionary Designed by Learning Vector Quantization , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification Via Shape-Adaptive Joint Sparse Representation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[48]  Yicong Zhou,et al.  Extreme Learning Machine With Composite Kernels for Hyperspectral Image Classification , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.