Hyperspectral Image Classification with Multi-Scale Feature Extraction

Spectral features cannot effectively reflect the differences among the ground objects and distinguish their boundaries in hyperspectral image (HSI) classification. Multi-scale feature extraction can solve this problem and improve the accuracy of HSI classification. The Gaussian pyramid can effectively decompose HSI into multi-scale structures, and efficiently extract features of different scales by stepwise filtering and downsampling. Therefore, this paper proposed a Gaussian pyramid based multi-scale feature extraction (MSFE) classification method for HSI. First, the HSI is decomposed into several Gaussian pyramids to extract multi-scale features. Second, we construct probability maps in each layer of the Gaussian pyramid and employ edge-preserving filtering (EPF) algorithms to further optimize the details. Finally, the final classification map is acquired by a majority voting method. Compared with other spectral-spatial classification methods, the proposed method can not only extract the characteristics of different scales, but also can better preserve detailed structures and the edge regions of the image. Experiments performed on three real hyperspectral datasets show that the proposed method can achieve competitive classification accuracy.

[1]  Bing Tu,et al.  Hyperspectral Image Classification via Superpixel Correlation Coefficient Representation , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Shutao Li,et al.  Feature Extraction With Multiscale Covariance Maps for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Antonio J. Plaza,et al.  Subspace-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[4]  Lei Guo,et al.  An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[6]  Chi Hau Chen,et al.  Statistical pattern recognition in remote sensing , 2008, Pattern Recognit..

[7]  Manuel Menezes de Oliveira Neto,et al.  Corrigendum to "Real-time line detection through an improved hough transform voting scheme" [Pattern Recognition 41 (1) 299-314] , 2008, Pattern Recognit..

[8]  Shutao Li,et al.  Gaussian Pyramid Based Multiscale Feature Fusion for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[11]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Hyperspectral Image Segmentation Using S , 2022 .

[12]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Exploiting Spectral–Spatial Information of Superpixel via Multiple Kernels , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Jon Atli Benediktsson,et al.  A spatial-spectral kernel-based approach for the classification of remote-sensing images , 2012, Pattern Recognit..

[14]  Xiaofei Zhang,et al.  Spectral–Spatial Hyperspectral Image Classification via Non-local Means Filtering Feature Extraction , 2018 .

[15]  Eyal Ben-Dor,et al.  Quantitative Detection of Settled Dust Over Green Canopy Using Sparse Unmixing of Airborne Hyperspectral Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Xiaofei Zhang,et al.  Density Peak-Based Noisy Label Detection for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Lorenzo Bruzzone,et al.  Kernel-based methods for hyperspectral image classification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Xiaofei Zhang,et al.  Hyperspectral Image Classification via Fusing Correlation Coefficient and Joint Sparse Representation , 2018, IEEE Geoscience and Remote Sensing Letters.

[19]  Qi Wang,et al.  Fast Hyperspectral Anomaly Detection via High-Order 2-D Crossing Filter , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Yicong Zhou,et al.  Region-Kernel-Based Support Vector Machines for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Hassan Ghassemian,et al.  Multiscale Gaussian Derivative Functions for Hyperspectral Image Feature Extraction , 2016, IEEE Geoscience and Remote Sensing Letters.

[22]  Jun Li,et al.  Advanced Spectral Classifiers for Hyperspectral Images: A review , 2017, IEEE Geoscience and Remote Sensing Magazine.

[23]  Jon Atli Benediktsson,et al.  Generalized Composite Kernel Framework for Hyperspectral Image Classification , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Shutao Li,et al.  Hyperspectral Image Classification With Squeeze Multibias Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[27]  Antonio J. Plaza,et al.  Semisupervised Hyperspectral Image Classification Using Soft Sparse Multinomial Logistic Regression , 2013, IEEE Geoscience and Remote Sensing Letters.

[28]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Jon Atli Benediktsson,et al.  Spatial Density Peak Clustering for Hyperspectral Image Classification With Noisy Labels , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Jian Zhu,et al.  Deformable Convolutional Neural Networks for Hyperspectral Image Classification , 2018, IEEE Geoscience and Remote Sensing Letters.

[31]  Zhou Guo,et al.  On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery , 2015 .

[32]  Joydeep Ghosh,et al.  An Active Learning Approach to Hyperspectral Data Classification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[33]  Trac D. Tran,et al.  Hyperspectral Image Classification via Kernel Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[34]  William J. Emery,et al.  Active Learning Methods for Remote Sensing Image Classification , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[37]  Steven J. Thomson,et al.  Determining the Effects of Storage on Cotton and Soybean Leaf Samples for Hyperspectral Analysis , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Zi Huang,et al.  Multi-Feature Fusion via Hierarchical Regression for Multimedia Analysis , 2013, IEEE Transactions on Multimedia.

[40]  Qian Du,et al.  Local Binary Patterns and Extreme Learning Machine for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Yuan Yan Tang,et al.  Mixed Noise Removal via Robust Constrained Sparse Representation , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Manuel Menezes de Oliveira Neto,et al.  Real-time line detection through an improved Hough transform voting scheme , 2008, Pattern Recognit..

[44]  Saurabh Prasad,et al.  Limitations of Principal Components Analysis for Hyperspectral Target Recognition , 2008, IEEE Geoscience and Remote Sensing Letters.

[45]  Gustavo Camps-Valls,et al.  Composite kernels for hyperspectral image classification , 2006, IEEE Geoscience and Remote Sensing Letters.

[46]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[47]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Antonio J. Plaza,et al.  Semi-supervised hyperspectral image segmentation , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[49]  Trac D. Tran,et al.  Hyperspectral Image Classification Using Dictionary-Based Sparse Representation , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Shutao Li,et al.  Remote Sensing Scene Classification Using Multilayer Stacked Covariance Pooling , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Daniel S. Yeung,et al.  A genetic algorithm for solving the inverse problem of support vector machines , 2005, Neurocomputing.

[52]  Jun Ye,et al.  Adaptive control of nonlinear PID-based analog neural networks for a nonholonomic mobile robot , 2008, Neurocomputing.

[53]  Michele Dalponte,et al.  Tree Species Classification in Boreal Forests With Hyperspectral Data , 2013, IEEE Transactions on Geoscience and Remote Sensing.