SuperPCA: A Superpixelwise PCA Approach for Unsupervised Feature Extraction of Hyperspectral Imagery

As an unsupervised dimensionality reduction method, the principal component analysis (PCA) has been widely considered as an efficient and effective preprocessing step for hyperspectral image (HSI) processing and analysis tasks. It takes each band as a whole and globally extracts the most representative bands. However, different homogeneous regions correspond to different objects, whose spectral features are diverse. Therefore, it is inappropriate to carry out dimensionality reduction through a unified projection for an entire HSI. In this paper, a simple but very effective superpixelwise PCA (SuperPCA) approach is proposed to learn the intrinsic low-dimensional features of HSIs. In contrast to classical PCA models, the SuperPCA has four main properties: 1) unlike the traditional PCA method based on a whole image, the SuperPCA takes into account the diversity in different homogeneous regions, that is, different regions should have different projections; 2) most of the conventional feature extraction models cannot directly use the spatial information of HSIs, while the SuperPCA is able to incorporate the spatial context information into the unsupervised dimensionality reduction by superpixel segmentation; 3) since the regions obtained by superpixel segmentation have homogeneity, the SuperPCA can extract potential low-dimensional features even under noise; and 4) although the SuperPCA is an unsupervised method, it can achieve a competitive performance when compared with supervised approaches. The resulting features are discriminative, compact, and noise-resistant, leading to an improved HSI classification performance. Experiments on three public data sets demonstrate that the SuperPCA model significantly outperforms the conventional PCA-based dimensionality reduction baselines for HSI classification, and some state-of-the-art feature extraction approaches. The MATLAB source code is available at https://github.com/junjun-jiang/SuperPCA.

[1]  Mark R. Pickering,et al.  Unsupervised feature extraction based on a mutual information measure for hyperspectral image classification , 2011, 2011 IEEE International Geoscience and Remote Sensing Symposium.

[2]  Jing Wang,et al.  Independent component analysis-based dimensionality reduction with applications in hyperspectral image analysis , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Yicong Zhou,et al.  Dimension Reduction Using Spatial and Spectral Regularized Local Discriminant Embedding for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  James E. Fowler,et al.  Classification and Reconstruction From Random Projections for Hyperspectral Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Bin Wang,et al.  A Novel Spatial–Spectral Similarity Measure for Dimensionality Reduction and Classification of Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Saurabh Prasad,et al.  Limitations of Principal Components Analysis for Hyperspectral Target Recognition , 2008, IEEE Geoscience and Remote Sensing Letters.

[7]  Craig A. Coburn,et al.  A multiscale texture analysis procedure for improved forest stand classification , 2004 .

[8]  Chen Chen,et al.  One-Two-One Networks for Compression Artifacts Reduction in Remote Sensing , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[9]  Melba M. Crawford,et al.  Manifold-Learning-Based Feature Extraction for Classification of Hyperspectral Data: A Review of Advances in Manifold Learning , 2014, IEEE Signal Processing Magazine.

[10]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[11]  Qi Wang,et al.  Salient Band Selection for Hyperspectral Image Classification via Manifold Ranking , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Sankar K. Pal,et al.  A review on image segmentation techniques , 1993, Pattern Recognit..

[13]  Thomas L. Ainsworth,et al.  Exploiting manifold geometry in hyperspectral imagery , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Junjun Jiang,et al.  Guided Locality Preserving Feature Matching for Remote Sensing Image Registration , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Li Ma,et al.  Anomaly Detection for Hyperspectral Images Based on Robust Locally Linear Embedding , 2010 .

[16]  Kim-Kwang Raymond Choo,et al.  Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification , 2016, Soft Computing.

[17]  Wei Wei,et al.  Latent subclass learning-based unsupervised ensemble feature extraction method for hyperspectral image classification , 2015 .

[18]  Jiang Li,et al.  Dimensionality reduction of hyperspectral data using discrete wavelet transform feature extraction , 2002, IEEE Trans. Geosci. Remote. Sens..

[19]  Lizhe Wang,et al.  Fast and Scalable Multi-Way Analysis of Massive Neural Data , 2015, IEEE Transactions on Computers.

[20]  Jiayi Ma,et al.  Infrared and visible image fusion methods and applications: A survey , 2018, Inf. Fusion.

[21]  Qian Du,et al.  Collaborative Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[23]  Xin Yu,et al.  Spatial Regularized Local Manifold Learning for Classification of Hyperspectral Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Sameer Antani,et al.  Local-global classifier fusion for screening chest radiographs , 2017, Medical Imaging.

[25]  Ting-Zhu Huang,et al.  Patch-Based Principal Component Analysis for Face Recognition , 2017, Comput. Intell. Neurosci..

[26]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[27]  Jiayi Ma,et al.  Infrared and visible image fusion via gradient transfer and total variation minimization , 2016, Inf. Fusion.

[28]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[29]  Qian Du,et al.  Sparse Graph-Based Discriminant Analysis for Hyperspectral Imagery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Rama Chellappa,et al.  Entropy rate superpixel segmentation , 2011, CVPR 2011.

[31]  Qingquan Li,et al.  A Novel Ranking-Based Clustering Approach for Hyperspectral Band Selection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Qian Du,et al.  Unsupervised Hyperspectral Band Selection Using Graphics Processing Units , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Images With a Superpixel-Based Discriminative Sparse Model , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Yi Yu,et al.  Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[36]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[38]  Marco Grangetto,et al.  Fast Superpixel-Based Hierarchical Approach to Image Segmentation , 2015, ICIAP.

[39]  Chengzhi Deng,et al.  Orthogonal Nonnegative Matrix Factorization Combining Multiple Features for Spectral–Spatial Dimensionality Reduction of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Liangpei Zhang,et al.  Efficient Superpixel-Level Multitask Joint Sparse Representation for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[42]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Xiaojun Shen,et al.  Part-based PCA for facial feature extraction and classification , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[45]  Valero Laparra,et al.  Dimensionality Reduction via Regression in Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Signal Processing.

[46]  Qian Du,et al.  Similarity-Based Unsupervised Band Selection for Hyperspectral Image Analysis , 2008, IEEE Geoscience and Remote Sensing Letters.

[47]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[49]  Steven Verstockt,et al.  Unsupervised spectral sub-feature learning for hyperspectral image classification , 2016 .

[50]  Arnak S. Dalalyan,et al.  Image denoising with patch based PCA: local versus global , 2011, BMVC.

[51]  Yansheng Li,et al.  Feature guided Gaussian mixture model with semi-supervised EM and local geometric constraint for retinal image registration , 2017, Inf. Sci..

[52]  James E. Fowler,et al.  Locality-Preserving Dimensionality Reduction and Classification for Hyperspectral Image Analysis , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[54]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[55]  Gang Yang,et al.  A Sparse and Low-Rank Near-Isometric Linear Embedding Method for Feature Extraction in Hyperspectral Imagery Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[56]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[57]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[58]  Shutao Li,et al.  Multiscale Superpixel-Based Sparse Representation for Hyperspectral Image Classification , 2017, Remote. Sens..

[59]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Yuan Yan Tang,et al.  Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images , 2019, IEEE Transactions on Cybernetics.

[61]  David A. Clausi,et al.  Intrinsic Representation of Hyperspectral Imagery for Unsupervised Feature Extraction , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Qian Du,et al.  Sparse and Low-Rank Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Jun Huang,et al.  Hyperspectral image denoising with superpixel segmentation and low-rank representation , 2017, Inf. Sci..

[65]  Saurabh Prasad,et al.  Decision Fusion With Confidence-Based Weight Assignment for Hyperspectral Target Recognition , 2008, IEEE Transactions on Geoscience and Remote Sensing.