Ensemble EMD-Based Spectral-Spatial Feature Extraction for Hyperspectral Image Classification

Hyperspectral images (HSIs) have fine spectral information, and rich spatial information, of which the feature quality is one of the key factors that affect the classification performance. Therefore, how to extract essential features, and eliminate redundant features from hyperspectral data are the main research focus of this article. Here, we propose a spectral-spatial feature extraction method based on ensemble empirical mode decomposition for HSI classification, which contains several steps as follows: First, the dimension reduction for HSI is performed by using the principal component analysis method. Second, in order to decrease the sensitivity to noise, and extract rough outline features, the adaptive total variation filtering (ATVF) is conducted on the selected principal components. Furthermore, by using the ensemble empirical mode decomposition (EEMD) to resolve each spectral band into sequence components, the features of HSIs can be better coalesced into the transform domain. Finally, the first $K$ principal components of the input image, and the outputs of the ATVF, and EEMD are integrated into a stacking system to obtain the final feature image, which is then classified by a pixel-wise classifier. The experimental results of three authentic hyperspectral datasets show that the proposed algorithm obtains a superior classification performance compared with other methods.

[1]  Chengle Zhou,et al.  Hyperspectral Anomaly Detection Using Dual Window Density , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[2]  L. Álvarez,et al.  Signal and image restoration using shock filters and anisotropic diffusion , 1994 .

[3]  Hanqing Zhao,et al.  A fast algorithm for the total variation model of image denoising , 2010, Adv. Comput. Math..

[4]  Yunsong Li,et al.  Cloud Detection in High-Resolution Remote Sensing Images Using Multi-features of Ground Objects , 2019, Journal of Geovisualization and Spatial Analysis.

[5]  Peijun Li,et al.  Annual Urban Expansion Extraction and Spatio-Temporal Analysis Using Landsat Time Series Data: A Case Study of Tianjin, China , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Jon Atli Benediktsson,et al.  Extended Random Walker-Based Classification of Hyperspectral Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Chi Hau Chen,et al.  Statistical pattern recognition in remote sensing , 2008, Pattern Recognit..

[8]  Tao Yu,et al.  Generative Adversarial Networks Based on Collaborative Learning and Attention Mechanism for Hyperspectral Image Classification , 2020, Remote. Sens..

[9]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[10]  Shiqian Ma,et al.  An alternating direction method for total variation denoising , 2011, Optim. Methods Softw..

[11]  Qian Du,et al.  Multifeature Dictionary Learning for Collaborative Representation Classification of Hyperspectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[12]  M. Siegel,et al.  Hyperspectral classification via deep networks and superpixel segmentation , 2015 .

[13]  Liang Xiao,et al.  Spatial-Spectral Kernel Sparse Representation for Hyperspectral Image Classification , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Naoto Yokoya,et al.  Invariant Attribute Profiles: A Spatial-Frequency Joint Feature Extractor for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Xu Tian Adaptive total variation model for image denoising with fast solving algorithm , 2011 .

[17]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[18]  Antonio J. Plaza,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING 1 Spectral–Spatial Classification of Hyperspectral Data Usi , 2022 .

[19]  Peng Qi-cong Adaptive image denoising model based on total variation , 2006 .

[20]  Ru Yang,et al.  Dictionary-Based, Clustered Sparse Representation for Hyperspectral Image Classification , 2015 .

[21]  Jon Atli Benediktsson,et al.  On Understanding Big Data Impacts in Remotely Sensed Image Classification Using Support Vector Machine Methods , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Pedram Ghamisi,et al.  Noise-Robust Hyperspectral Image Classification via Multi-Scale Total Variation , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Weimin Huang,et al.  Wind Direction Estimation From Rain-Contaminated Marine Radar Data Using the Ensemble Empirical Mode Decomposition Method , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Jiashu Zhang,et al.  Fractional-order total variation combined with sparsifying transforms for compressive sensing sparse image reconstruction , 2016, J. Vis. Commun. Image Represent..

[27]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Peijun Du,et al.  (Semi-) Supervised Probabilistic Principal Component Analysis for Hyperspectral Remote Sensing Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Jon Atli Benediktsson,et al.  Automatic Framework for Spectral–Spatial Classification Based on Supervised Feature Extraction and Morphological Attribute Profiles , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Di Wang,et al.  Adaptive Spectral–Spatial Multiscale Contextual Feature Extraction for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Norden E. Huang,et al.  The Multi-Dimensional Ensemble Empirical Mode Decomposition Method , 2009, Adv. Data Sci. Adapt. Anal..

[32]  Ali Mohammad-Djafari,et al.  Bayesian Approach With Hidden Markov Modeling and Mean Field Approximation for Hyperspectral Data Analysis , 2008, IEEE Transactions on Image Processing.

[33]  Hsuan-Ming Huang,et al.  Accelerating an Ordered-Subset Low-Dose X-Ray Cone Beam Computed Tomography Image Reconstruction with a Power Factor and Total Variation Minimization , 2016, PloS one.

[34]  Yichun Xie,et al.  Chaos Theory-Based Data-Mining Technique for Image Endmember Extraction: Laypunov Index and Correlation Dimension (L and D) , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Antonio J. Plaza,et al.  A Quantitative and Comparative Assessment of Unmixing-Based Feature Extraction Techniques for Hyperspectral Image Classification , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[36]  Lorenzo Bruzzone,et al.  Extended profiles with morphological attribute filters for the analysis of hyperspectral data , 2010 .

[37]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Independent Component Discriminant Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[38]  James E. Fowler,et al.  Information Fusion in the Redundant-Wavelet-Transform Domain for Noise-Robust Hyperspectral Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Chengle Zhou,et al.  Hyperspectral Classification With Noisy Label Detection via Superpixel-to-Pixel Weighting Distance , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Antonio J. Plaza,et al.  Hyperspectral Image Segmentation Using a New Bayesian Approach With Active Learning , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Gabriel Rilling,et al.  On empirical mode decomposition and its algorithms , 2003 .

[42]  Jon Atli Benediktsson,et al.  A Study on the Effectiveness of Different Independent Component Analysis Algorithms for Hyperspectral Image Classification , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[43]  R. Jia,et al.  Applied and Computational Harmonic Analysis Convergence Analysis of the Bregman Method for the Variational Model of Image Denoising , 2022 .

[44]  Luís B. Almeida,et al.  Blind and Semi-Blind Deblurring of Natural Images , 2010, IEEE Transactions on Image Processing.

[45]  Jon Atli Benediktsson,et al.  SVM- and MRF-Based Method for Accurate Classification of Hyperspectral Images , 2010, IEEE Geoscience and Remote Sensing Letters.

[46]  Dianjun Zhang,et al.  Manifold Learning Co-Location Decision Tree for Remotely Sensed Imagery Classification , 2016, Remote. Sens..

[47]  Jon Atli Benediktsson,et al.  Spectral–Spatial Classification of Hyperspectral Imagery Based on Partitional Clustering Techniques , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Jon Atli Benediktsson,et al.  Multiple Feature Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Edoardo Pasolli,et al.  An Active Learning Framework for Hyperspectral Image Classification Using Hierarchical Segmentation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[50]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[51]  Jon Atli Benediktsson,et al.  Spectral-Spatial Hyperspectral Image Classification Using Subspace-Based Support Vector Machines and Adaptive Markov Random Fields , 2016, Remote. Sens..

[52]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[53]  Xuelong Li,et al.  A Hybrid Sparsity and Distance-Based Discrimination Detector for Hyperspectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[55]  Bo Du,et al.  A batch-mode active learning framework by querying discriminative and representative samples for hyperspectral image classification , 2016, Neurocomputing.

[56]  James E. Fowler,et al.  Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification , 2011, IEEE Geoscience and Remote Sensing Letters.

[57]  Jon Atli Benediktsson,et al.  Segmentation and classification of hyperspectral images using watershed transformation , 2010, Pattern Recognit..

[58]  Qingshan Liu,et al.  Cascaded Recurrent Neural Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[59]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Shaoguang Zhou,et al.  Discriminative Sparse Representation for Hyperspectral Image Classification: A Semi-Supervised Perspective , 2017, Remote. Sens..

[61]  Yao Yu,et al.  Ensemble Learning for Hyperspectral Image Classification Using Tangent Collaborative Representation , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Marimuthu Palaniswami,et al.  Ensemble Empirical Mode Decomposition With Principal Component Analysis: A Novel Approach for Extracting Respiratory Rate and Heart Rate From Photoplethysmographic Signal , 2018, IEEE Journal of Biomedical and Health Informatics.

[63]  Jon Atli Benediktsson,et al.  Spatial Density Peak Clustering for Hyperspectral Image Classification With Noisy Labels , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[64]  Naoto Yokoya,et al.  Learning to propagate labels on graphs: An iterative multitask regression framework for semi-supervised hyperspectral dimensionality reduction , 2019, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[65]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[66]  Chunhua Zhang,et al.  The application of small unmanned aerial systems for precision agriculture: a review , 2012, Precision Agriculture.

[67]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification Via Shape-Adaptive Joint Sparse Representation , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[68]  Qian Du,et al.  Kernel Collaborative Representation With Local Correlation Features for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[69]  Pedram Ghamisi,et al.  Spectral–Spatial Classification of Hyperspectral Images Based on Hidden Markov Random Fields , 2014, IEEE Transactions on Geoscience and Remote Sensing.