Class-Dependent Sparse Representation Classifier for Robust Hyperspectral Image Classification

Sparse representation of signals for classification is an active research area. Signals can potentially have a compact representation as a linear combination of atoms in an overcomplete dictionary. Based on this observation, a sparse-representation-based classification (SRC) has been proposed for robust face recognition and has gained popularity for various classification tasks. It relies on the underlying assumption that a test sample can be linearly represented by a small number of training samples from the same class. However, SRC implementations ignore the Euclidean distance relationship between samples when learning the sparse representation of a test sample in the given dictionary. To overcome this drawback, we propose an alternate formulation that we assert is better suited for classification tasks. Specifically, class-dependent sparse representation classifier (cdSRC) is proposed for hyperspectral image classification, which effectively combines the ideas of SRC and K-nearest neighbor classifier in a classwise manner to exploit both correlation and Euclidean distance relationship between test and training samples. Toward this goal, a unified class membership function is developed, which utilizes residual and Euclidean distance information simultaneously. Experimental results based on several real-world hyperspectral data sets have shown that cdSRC not only dramatically increases the classification performance over SRC but also outperforms other popular classifiers, such as support vector machine.

[1]  James E. Fowler,et al.  Segmented Mixture-of-Gaussian Classification for Hyperspectral Image Analysis , 2014, IEEE Geoscience and Remote Sensing Letters.

[2]  Saurabh Prasad,et al.  Sparsity promoting dimensionality reduction for classification of high dimensional hyperspectral images , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Li Ma,et al.  Local Manifold Learning-Based $k$ -Nearest-Neighbor for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[4]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[5]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale l1-Regularized Logistic Regression , 2007, J. Mach. Learn. Res..

[6]  James E. Fowler,et al.  Nearest Regularized Subspace for Hyperspectral Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[8]  Ralph Bernstein,et al.  Gaussian Maximum Likelihood and Contextual Classification Algorithms for Multicrop Classification , 1987, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[10]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[12]  Trac D. Tran,et al.  Exploiting Sparsity in Hyperspectral Image Classification via Graphical Models , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  Melba M. Crawford,et al.  Manifold learning based feature extraction for classification of hyper-spectral data , 2013 .

[14]  Paolo Gamba,et al.  A collection of data for urban area characterization , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[16]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[18]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  James E. Fowler,et al.  Information Fusion in the Redundant-Wavelet-Transform Domain for Noise-Robust Hyperspectral Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Rick Archibald,et al.  Feature Selection and Classification of Hyperspectral Images With Support Vector Machines , 2007, IEEE Geoscience and Remote Sensing Letters.

[21]  Saurabh Prasad,et al.  Locality Preserving Genetic Algorithms for Spatial-Spectral Hyperspectral Image Classification , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Pascal Vincent,et al.  Kernel Matching Pursuit , 2002, Machine Learning.

[24]  James E. Fowler,et al.  Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[25]  Luis Samaniego,et al.  Supervised Classification of Remotely Sensed Imagery Using a Modified $k$-NN Technique , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[27]  Melba M. Crawford,et al.  Manifold-Learning-Based Feature Extraction for Classification of Hyperspectral Data: A Review of Advances in Manifold Learning , 2014, IEEE Signal Processing Magazine.

[28]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.