Learning a local manifold representation based on improved neighborhood rough set and LLE for hyperspectral dimensionality reduction

Abstract Hyperspectral data with high dimensionality always needs more storage space and increases the computational consumption, manifold learning based dimensionality reduction method is a popular way to meet these requirements. Local manifold learning consists of two vital steps: neighbors selection and weights computation, and the former is critical to the accuracy of the result. In this paper, an improved neighborhood rough set (INRS) and local linear embedding (LLE) are proposed for local neighbors selection, thus INRSLLE is proposed. Firstly, neighbor candidates are selected using Euclidean distance and spectral distance, then a parameter undirected graph is constructed from original data to improve the anti-noise ability. INRS improved by this parameter undirected graph can select enough neighbors from these candidates, which increases the contribution of neighbors to corresponding samples. Finally, LLE is used to learn local manifold representation. Results of the proposed method and comparison methods like NMF and LP-KSVD have been classified by four different classifiers respectively. Experimental results performed over two real-world hyperspectral datasets indicate the proposed INRSLLE not only considers the spectral-spatial information of hyperspectral data, but also selects more suitable neighbors on local manifolds and increases the anti-noise ability.

[1]  Amir Averbuch,et al.  Delineation of malignant skin tumors by hyperspectral imaging using diffusion maps dimensionality reduction , 2015, Biomed. Signal Process. Control..

[2]  Guillermo Sapiro,et al.  Spatially Coherent Nonlinear Dimensionality Reduction and Segmentation of Hyperspectral Images , 2007, IEEE Geoscience and Remote Sensing Letters.

[3]  Ruimin Hu,et al.  CDMMA: Coupled discriminant multi-manifold analysis for matching low-resolution face images , 2016, Signal Process..

[4]  Hongyuan Wang,et al.  Dimensionality Reduction of Hyperspectral Images Based on Robust Spatial Information Using Locally Linear Embedding , 2014, IEEE Geoscience and Remote Sensing Letters.

[5]  Lorenzo Bruzzone,et al.  Discriminative Feature Metric Learning in the Affinity Propagation Model for Band Selection in Hyperspectral Images , 2017, Remote. Sens..

[6]  Hongyuan Zha,et al.  Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment , 2002, ArXiv.

[7]  Liu Yang,et al.  The fusion arithmetic of multi-resolution remote sense image based on a modified fast independent component analysis , 2007, 2007 1st Asian and Pacific Conference on Synthetic Aperture Radar.

[8]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Balázs Kégl,et al.  Intrinsic Dimension Estimation Using Packing Numbers , 2002, NIPS.

[10]  Yi Shen,et al.  Low rank constraint and spatial spectral total variation for hyperspectral image mixed denoising , 2018, Signal Process..

[11]  Xiaoying Jin,et al.  A comparative study of target detection algorithms for hyperspectral imagery , 2009, Defense + Commercial Sensing.

[12]  Barnali Barman,et al.  Hyperspectral image analysis using neighborhood rough set and mathematical morphology , 2016, 2016 International Conference on Accessibility to Digital World (ICADW).

[13]  Xu-Chu Yu,et al.  Hyperspectral remote sensing image classification based on kernel fisher discriminant analysis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[14]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[15]  Kenneth E. Barner,et al.  Locality preserving KSVD for nonlinear manifold learning , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Xianglei Xing,et al.  Couple manifold discriminant analysis with bipartite graph embedding for low-resolution face recognition , 2016, Signal Process..

[17]  Yao Liu,et al.  Hyperspectral band selection based on a variable precision neighborhood rough set. , 2016, Applied optics.

[18]  Pascal Frossard,et al.  Tangent-based manifold approximation with locally linear models , 2012, Signal Process..

[19]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[20]  Jicong Fan,et al.  Nonlinear Dimensionality Reduction for Data with Disconnected Neighborhood Graph , 2017, Neural Processing Letters.

[21]  Naoto Yokoya,et al.  Learning a Robust Local Manifold Representation for Hyperspectral Dimensionality Reduction , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Lei Yu,et al.  Sparse multiple maximum scatter difference for dimensionality reduction , 2017, Digit. Signal Process..

[23]  Michael J. DeWeert,et al.  In-flight MTF characterization for high-resolution aerial reconnaissance , 2003, SPIE Defense + Commercial Sensing.

[24]  Marco Pisani,et al.  A Hyperspectral Camera in the UVA Band , 2015, IEEE Transactions on Instrumentation and Measurement.

[25]  Asad Mahmood,et al.  Estimation of the Intrinsic Dimension of Hyperspectral Images: Comparison of Current Methods , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[26]  Jiaqi Jia,et al.  Automatic target recognition system for unmanned aerial vehicle via backpropagation artificial neural network , 2017 .

[27]  Guangyi Chen,et al.  Dimensionality reduction of hyperspectral imagery using improved locally linear embedding , 2007 .

[28]  Xindong Wu,et al.  Online feature selection for high-dimensional class-imbalanced data , 2017, Knowl. Based Syst..

[29]  Qian Du,et al.  Fast and Robust Self-Representation Method for Hyperspectral Band Selection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Peter J. Bickel,et al.  Maximum Likelihood Estimation of Intrinsic Dimension , 2004, NIPS.

[31]  Studies of High Spectral Resolution Atmospheric Sounding Data Compression and Noise Reduction Based on Principal Component Analysis Method , 2009, 2009 2nd International Congress on Image and Signal Processing.

[32]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[33]  Zhigang Liu,et al.  Dimensionality Reduction for Hyperspectral Image Based on Manifold Learning , 2015, ICIG.

[34]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[35]  Zhen Xu,et al.  Hyperspectral band selection based on consistency-measure of neighborhood rough set theory , 2016 .

[36]  Jon Atli Benediktsson,et al.  Kernel Principal Component Analysis for the Classification of Hyperspectral Remote Sensing Data over Urban Areas , 2009, EURASIP J. Adv. Signal Process..

[37]  Saurabh Prasad,et al.  Class-Dependent Sparse Representation Classifier for Robust Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Zhen Xu,et al.  Maximum relevance, minimum redundancy band selection based on neighborhood rough set for hyperspectral data classification , 2016 .

[39]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[40]  Wang,et al.  Kernel ICA Feature Extraction for Anomaly Detection in Hyperspectral Imagery , 2012 .

[41]  Gérard G. Medioni,et al.  Unsupervised Dimensionality Estimation and Manifold Learning in high-dimensional Spaces by Tensor Voting , 2005, IJCAI.

[42]  S. Bourennane,et al.  Constrained nonnegative matrix factorization and hyperspectral image dimensionality reduction , 2014 .

[43]  Hassan Ghassemian,et al.  Marginal discriminant analysis using support vectors for dimensionality reduction of hyperspectral data , 2016 .