Robust deflated principal component analysis via multiple instance factorings for dimension reduction in remote sensing images

Abstract. Remote sensing data are often adversely affected by noises due to atmospheric water absorption, transmission errors, sensor sensitivity, and saturation. Therefore, the performance of the classical principal component analysis (PCA) is negatively affected when dealing with such noisy data. To overcome this problem, a robust deflated PCA via multiple instance factorings (RDPCA-MIF) for dimension reduction in remote sensing images is proposed. In contrast to the traditional PCA, a penalty is imposed on the instance space through instance factoring technique to suppress the effect of noise in pursuing projections. To achieve this, we use two strategies, total distance, and cosine similarity metrics. Both strategies discriminate between noise and authentic data points by iteratively learning the relationship between instances and projections. Moreover, a deflation strategy that enables multiple relationships learning between instances and projections is applied to thoroughly evaluate the importance of instances in relation to all projections. Extensive experimental evaluations of the proposed RDPCA-MIF on Salinas-A dataset and shallow and deep features from the NWPU-RESISC45 remote sensing dataset prove its superiority over six comparative methods in dimension reduction and classification tasks.

[1]  M. Lynn,et al.  Multiple Wielandt deflations in the numerical solution of singular integral equations of potential theory , 1968, ACM National Conference.

[2]  Ram M. Narayanan,et al.  Noise reduction in remote sensing imagery using data masking and principal component analysis , 2000, SPIE Optics + Photonics.

[3]  A. Smilde,et al.  Deflation in multiblock PLS , 2001 .

[4]  Luis Mateus Rocha,et al.  Singular value decomposition and principal component analysis , 2003 .

[5]  Ram M. Narayanan,et al.  Noise estimation in remote sensing imagery using data masking , 2003 .

[6]  R. Narayanan,et al.  Effects of Noise on the Information Content of Remote Sensing Images , 2003 .

[7]  G. Irwin,et al.  Deflation based nonlinear canonical correlation analysis , 2006 .

[8]  Jieping Ye,et al.  Integrating Global and Local Structures: A Least Squares Framework for Dimensionality Reduction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[10]  Andrew Beng Jin Teoh,et al.  Face recognition based on neighbourhood discriminant preserving embedding , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[11]  B Ludäscher,et al.  Scientific and Statistical Database Management, 20th International Conference, SSDBM 2008, Hong Kong, China, July 9-11, 2008, Proceedings , 2008, SSDBM.

[12]  Guangyi Chen,et al.  Simultaneous dimensionality reduction and denoising of hyperspectral imagery using bivariate wavelet shrinking and principal component analysis , 2008 .

[13]  Lester W. Mackey,et al.  Deflation Methods for Sparse PCA , 2008, NIPS.

[14]  Hans-Peter Kriegel,et al.  A General Framework for Increasing the Robustness of PCA-Based Correlation Clustering Algorithms , 2008, SSDBM.

[15]  Dewen Hu,et al.  A Direct Locality Preserving Projections (DLPP) Algorithm for Image Recognition , 2008, Neural Processing Letters.

[16]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[17]  Zhongfei Zhang,et al.  Linear discriminant analysis using rotational invariant L1 norm , 2010, Neurocomputing.

[18]  Renato D. C. Monteiro,et al.  An algorithm for sparse PCA based on a new sparsity control criterion , 2011 .

[19]  Marco Diani,et al.  Subspace-Based Striping Noise Reduction in Hyperspectral Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Mehran Yazdi,et al.  Noise Reduction of Hyperspectral Images Using Kernel Non-Negative Tucker Decomposition , 2011, IEEE Journal of Selected Topics in Signal Processing.

[21]  Guangyi Chen,et al.  Denoising of Hyperspectral Imagery Using Principal Component Analysis and Wavelet Shrinkage , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Qi Wang,et al.  3-D nonlocal means filter with noise estimation for hyperspectral imagery denoising , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[23]  Yang Wang,et al.  Sparse PCA by iterative elimination algorithm , 2011, Advances in Computational Mathematics.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  E. Qannari,et al.  Deflation strategies for multi-block principal component analysis revisited , 2013 .

[26]  Jin Tang,et al.  Graph-Laplacian PCA: Closed-Form Solution and Robustness , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Jiashu Zhang,et al.  Linear Discriminant Analysis Based on L1-Norm Maximization , 2013, IEEE Transactions on Image Processing.

[28]  Klaus Nordhausen,et al.  Deflation-Based FastICA With Adaptive Choices of Nonlinearities , 2014, IEEE Transactions on Signal Processing.

[29]  Stephen Marshall,et al.  Effective Feature Extraction and Data Reduction in Remote Sensing Using Hyperspectral Imaging [Applications Corner] , 2014, IEEE Signal Processing Magazine.

[30]  Feiping Nie,et al.  Optimal Mean Robust Principal Component Analysis , 2014, ICML.

[31]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[32]  P. Deepa,et al.  Feature extraction of hyperspectral image using principal component analysis and folded-principal component analysis , 2015, 2015 2nd International Conference on Electronics and Communication Systems (ICECS).

[33]  Liangpei Zhang,et al.  Hyperspectral Image Denoising via Noise-Adjusted Iterative Low-Rank Matrix Approximation , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[34]  Xin Yu,et al.  Spatial Regularized Local Manifold Learning for Classification of Hyperspectral Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Jon Atli Benediktsson,et al.  One-Class Oriented Feature Selection and Classification of Heterogeneous Remote Sensing Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Hongxun Yao,et al.  An Informative Feature Selection Method Based on Sparse PCA for VHR Scene Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[37]  Nojun Kwak,et al.  Generalized mean for robust principal component analysis , 2016, Pattern Recognit..

[38]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Jorge Cadima,et al.  Principal component analysis: a review and recent developments , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[40]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[41]  Dao-Qing Dai,et al.  Regularized coplanar discriminant analysis for dimensionality reduction , 2017, Pattern Recognit..

[42]  Laurent Albera,et al.  A Penalized Semialgebraic Deflation ICA Algorithm for the Efficient Extraction of Interictal Epileptic Signals , 2017, IEEE Journal of Biomedical and Health Informatics.

[43]  Abdeldjalil Aïssa-El-Bey,et al.  Sparse and smooth canonical correlation analysis through rank-1 matrix approximation , 2017, EURASIP J. Adv. Signal Process..

[44]  Yanning Zhang,et al.  Hyperspectral Image Spectral-Spatial Feature Extraction via Tensor Principal Component Analysis , 2017, IEEE Geoscience and Remote Sensing Letters.

[45]  Wu Lingda,et al.  Denoising of Hyperspectral Images Based on Principal Component Analysis and Adaptive Sparse Coding , 2018, 2018 10th IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS).

[46]  Sajid Javed,et al.  Robust Subspace Learning: Robust PCA, Robust Subspace Tracking, and Robust Subspace Recovery , 2017, IEEE Signal Processing Magazine.

[47]  Xiliang Ni,et al.  The Classification of Noise-Afflicted Remotely Sensed Data Using Three Machine-Learning Techniques: Effect of Different Levels and Types of Noise on Accuracy , 2018, ISPRS Int. J. Geo Inf..

[48]  Lizhe Wang,et al.  SuperPCA: A Superpixelwise PCA Approach for Unsupervised Feature Extraction of Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Bin Luo,et al.  Feature selection based on correlation deflation , 2019, Neural Computing and Applications.

[50]  Jinye Peng,et al.  Dimensionality reduction based on parallel factor analysis model and independent component analysis method , 2019 .

[51]  Hong Huang,et al.  Dimensionality Reduction of Hyperspectral Image Using Spatial-Spectral Regularized Sparse Hypergraph Embedding , 2019, Remote. Sens..

[52]  Heping Song,et al.  Incomplete-Data Oriented Dimension Reduction via Instance Factoring PCA Framework , 2019, ICIG.

[53]  Tor Arne Johansen,et al.  The effect of dimensionality reduction on signature-based target detection for hyperspectral remote sensing , 2019, Optical Engineering + Applications.

[54]  Jane You,et al.  Hyperspectral image unsupervised classification by robust manifold matrix factorization , 2019, Inf. Sci..

[55]  Y. Zhao Image and Graphics: 10th International Conference, ICIG 2019, Beijing, China, August 23–25, 2019, Proceedings, Part III , 2019, ICIG.