Dimensionality Reduction and Classification of Hyperspectral Images Using Ensemble Discriminative Local Metric Learning

The high-dimensional data space of hyperspectral images (HSIs) often result in ill-conditioned formulations, which finally leads to many of the high-dimensional feature spaces being empty and the useful data existing primarily in a subspace. To avoid these problems, we use distance metric learning for dimensionality reduction. The goal of distance metric learning is to incorporate abundant discriminative information by reducing the dimensionality of the data. Considering that global metric learning is not appropriate for all training samples, this paper proposes an ensemble discriminative local metric learning (EDLML) algorithm for HSI analysis. The EDLML algorithm learns robust local metrics from both the training samples and the relative neighborhood of them and considers the different local discriminative distance metrics by dealing with the data region by region. It aims to learn a subspace to keep all the samples in the same class are as near as possible, while those from different classes are separated. The learned local metrics are then used to build an ensemble metric. Experiments on a number of different hyperspectral data sets confirm the effectiveness of the proposed EDLML algorithm compared with that of the other dimension reduction methods.

[1]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Kernel Machines , 2012, ArXiv.

[2]  Chengzhi Deng,et al.  Orthogonal Nonnegative Matrix Factorization Combining Multiple Features for Spectral–Spatial Dimensionality Reduction of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Hongwei She,et al.  Feature extraction of hyperspectral images based on preserving neighborhood discriminant embedding , 2010, 2010 International Conference on Image Analysis and Signal Processing.

[4]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[5]  Gui-Song Xia,et al.  Accurate Annotation of Remote Sensing Images via Active Spectral Clustering with Little Expert Knowledge , 2015, Remote. Sens..

[6]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[7]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Antonio J. Plaza,et al.  Dimensionality reduction and classification of hyperspectral image data using sequences of extended morphological transformations , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[9]  David A. Landgrebe,et al.  Analyzing high-dimensional multispectral data , 1993, IEEE Trans. Geosci. Remote. Sens..

[10]  Dacheng Tao,et al.  Local discriminative distance metrics ensemble learning , 2013, Pattern Recognit..

[11]  Mei Yang,et al.  Dimensionality Reduction of Hyperspectral Images With Sparse Discriminant Embedding , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[12]  J. Campbell Introduction to remote sensing , 1987 .

[13]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Chein-I Chang,et al.  Hyperspectral image classification and dimensionality reduction: an orthogonal subspace projection approach , 1994, IEEE Trans. Geosci. Remote. Sens..

[15]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[16]  Ivor W. Tsang,et al.  Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction , 2010, IEEE Transactions on Image Processing.

[17]  Xuelong Li,et al.  Semi-Supervised Multitask Learning for Scene Recognition , 2015, IEEE Transactions on Cybernetics.

[18]  Licheng Jiao,et al.  Hyperspectral Band Selection Based on Trivariate Mutual Information and Clonal Selection , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Bo Du,et al.  Ensemble manifold regularized sparse low-rank approximation for multiview feature embedding , 2015, Pattern Recognit..

[20]  Lei Wang,et al.  Scalable Large-Margin Mahalanobis Distance Metric Learning , 2010, IEEE Transactions on Neural Networks.

[21]  Xiangrong Zhang,et al.  Semisupervised Dimensionality Reduction of Hyperspectral Images via Local Scaling Cut Criterion , 2013, IEEE Geoscience and Remote Sensing Letters.

[22]  Chein-I. Chang Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[23]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[24]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[25]  Xin Yao,et al.  Application of Genetic Algorithm and K-Nearest Neighbour Method in Real World Medical Fraud Detection Problem , 2000, J. Adv. Comput. Intell. Intell. Informatics.

[26]  Yuan Tian,et al.  Local Patch Discriminative Metric Learning for Hyperspectral Image Feature Extraction , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  Yicong Zhou,et al.  Dimension Reduction Using Spatial and Spectral Regularized Local Discriminant Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Bo Du,et al.  Target Detection Based on Random Forest Metric Learning , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Liangpei Zhang,et al.  Dimensionality Reduction Based on Clonal Selection for Hyperspectral Imagery , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[31]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Amir Globerson,et al.  Metric Learning by Collapsing Classes , 2005, NIPS.

[33]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[35]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[36]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[37]  Dacheng Tao,et al.  Discriminative Locality Alignment , 2008, ECCV.

[38]  Meng Wang,et al.  Semisupervised Multiview Distance Metric Learning for Cartoon Synthesis , 2012, IEEE Transactions on Image Processing.

[39]  Guillermo Sapiro,et al.  Dimensionality Reduction via Subspace and Submanifold Learning [From the Guest Editors] , 2011, IEEE Signal Process. Mag..

[40]  Bo Du,et al.  A Low-Rank and Sparse Matrix Decomposition-Based Mahalanobis Distance Method for Hyperspectral Anomaly Detection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Qian Du,et al.  Particle Swarm Optimization-Based Hyperspectral Dimensionality Reduction for Urban Land Cover Classification , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[43]  Bor-Chen Kuo,et al.  Kernel Nonparametric Weighted Feature Extraction for Hyperspectral Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Junwei Han,et al.  Efficient, simultaneous detection of multi-class geospatial targets based on visual saliency modeling and discriminative learning of sparse coding , 2014 .

[45]  René Vidal,et al.  Robust classification using structured sparse representation , 2011, CVPR 2011.

[46]  Bo Du,et al.  Exploring Locally Adaptive Dimensionality Reduction for Hyperspectral Image Classification: A Maximum Margin Metric Learning Aspect , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[47]  Fei Wang,et al.  Semisupervised Metric Learning by Maximizing Constraint Margin , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[48]  James E. Fowler,et al.  Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Misha Pavel,et al.  Adjustment Learning and Relevant Component Analysis , 2002, ECCV.

[50]  Ralph Bernstein,et al.  Gaussian Maximum Likelihood and Contextual Classification Algorithms for Multicrop Classification , 1987, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Russell M. Mersereau,et al.  On the impact of PCA dimension reduction for hyperspectral detection of difficult targets , 2005, IEEE Geoscience and Remote Sensing Letters.

[53]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[54]  James E. Fowler,et al.  Nearest Regularized Subspace for Hyperspectral Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[55]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[56]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[57]  Aleksandra Pizurica,et al.  Semisupervised Local Discriminant Analysis for Feature Extraction in Hyperspectral Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[58]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[59]  Jitendra Malik,et al.  Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[60]  Jiayan Jiang,et al.  Learning a mixture of sparse distance metrics for classification and dimensionality reduction , 2011, 2011 International Conference on Computer Vision.

[61]  Bo Du,et al.  Random-Selection-Based Anomaly Detector for Hyperspectral Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Guillermo Sapiro,et al.  Dimensionality Reduction via Subspace and Submanifold Learning , 2011 .

[64]  Bo Du,et al.  Maximum margin metric learning based target detection for hyperspectral images , 2015 .