Residual deep PCA-based feature extraction for hyperspectral image classification

In hyperspectral image (HSI) classification, a big challenge is the limited sample size with a relatively high feature dimension. Therefore, effective feature extraction of data is essential, which is desired to remove the redundancy as well as improve the discrimination. A huge number of methods have been proposed for HSI feature extraction. In recent years, deep learning-based feature extraction algorithms have shown their superiorities in various classification problems. Within them, deep PCA (DPCA) is a simple but efficient algorithm, which runs fast due to the absence of back-propagation. However, DPCA fails to provide satisfactory classification accuracies on HSI datasets. In this paper, we try to combine DPCA with residual-based multi-scale feature extraction and propose a residual deep PCA (RDPCA) feature extraction algorithm for HSI classification. It is a hierarchical approach consisting of multiple layers. Within each layer, PCA is utilized for layer-wise feature extraction, and the reconstruction residual is fed into the next layer. When the feature is passed deeper into the RDPCA network, finer details are mined. The layer-wise features are concatenated to form the final output feature. Furthermore, to enhance the ability of nonlinear feature extraction, we add activation functions between adjacent layers. Experimental results on real-world HSI datasets have shown the superiority of the proposed RDPCA over DPCA and PCA.

[1]  Gang Wang,et al.  Face recognition using Deep PCA , 2013, 2013 9th International Conference on Information, Communications & Signal Processing.

[2]  Paul A. Viola,et al.  A Non-Parametric Multi-Scale Statistical Model for Natural Images , 1997, NIPS.

[3]  Hasan Ali Akyürek,et al.  Semi-supervised fuzzy neighborhood preserving analysis for feature extraction in hyperspectral remote sensing images , 2019, Neural Computing and Applications.

[4]  Jun Zhou,et al.  Conditional Random Field and Deep Feature Learning for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Chang-Su Kim,et al.  Dark image enhancement based onpairwise target contrast and multi-scale detail boosting , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[6]  Qian Du,et al.  Gabor-Filtering-Based Nearest Regularized Subspace for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[7]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[10]  Zhenmin Tang,et al.  Fusing hierarchical multi-scale local binary patterns and virtual mirror samples to perform face recognition , 2015, Neural Computing and Applications.

[11]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[12]  Haiyan Gu,et al.  An Efficient Parallel Multi-Scale Segmentation Method for Remote Sensing Imagery , 2018, Remote. Sens..

[13]  Qian Du,et al.  Combined sparse and collaborative representation for hyperspectral target detection , 2015, Pattern Recognit..

[14]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jian Li,et al.  Hierarchical Building Extraction from High-resolution Remote Sensing Imagery Based on Multi-feature and Multi-scale Method , 2018, ICMIP 2018.

[17]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[18]  Xing Zhao,et al.  Spectral–Spatial Classification of Hyperspectral Data Based on Deep Belief Network , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  Jie Geng,et al.  Hyperspectral image classification via contextual deep learning , 2015, EURASIP Journal on Image and Video Processing.

[20]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[21]  Shengcai Liao,et al.  Learning Multi-scale Block Local Binary Patterns for Face Recognition , 2007, ICB.

[22]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Zhenwei Shi,et al.  MugNet: Deep learning for hyperspectral image classification using limited samples , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[24]  Huijuan Lu,et al.  Cross-scene hyperspectral image classification based on DWT and manifold-constrained subspace learning , 2017, Int. J. Wavelets Multiresolution Inf. Process..

[25]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[26]  Vicente Pérez-Muñuzuri,et al.  Extreme Wave Height Events in NW Spain: A Combined Multi-Sensor and Model Approach , 2017, Remote. Sens..

[27]  Geoffrey E. Hinton,et al.  On deep generative models with applications to recognition , 2011, CVPR 2011.

[28]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Lin Lei,et al.  Multi-scale object detection in remote sensing imagery with convolutional neural networks , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  Chengsheng Yuan,et al.  Fingerprint liveness detection based on multi-scale LPQ and PCA , 2016, China Communications.

[31]  Svetlana Lazebnik,et al.  Multi-scale Orderless Pooling of Deep Convolutional Activation Features , 2014, ECCV.

[32]  AbdiHervé,et al.  Principal Component Analysis , 2010, Essentials of Pattern Recognition.

[33]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[34]  Qian Du,et al.  Remote Sensing Image Scene Classification Using Multi-Scale Completed Local Binary Patterns and Fisher Vectors , 2016, Remote. Sens..

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  H. Abdi,et al.  Principal component analysis , 2010 .

[37]  Lori M. Bruce,et al.  Why principal component analysis is not an appropriate feature extraction method for hyperspectral data , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).