An Improved Feature Set for Hyperspectral Image Classification: Harmonic Analysis Optimized by Multiscale Guided Filter

Effective features derived from an original hyperspectral image (HSI) are quite important to improve the classification performance. An improved feature set, namely HGFM, is constructed by integrating harmonic analysis (HA) optimized by a multiscale guided filter (GF) with morphological operation for HSI classification. To establish HGFM, HA is first adopted to convert the HSI from spectral space to the frequency domain represented by amplitude, phase, and residual. With the first component of minimum noise fraction obtained from the original HSI as the guidance image, the harmonic components are then processed by the multiscale GF. Finally, the obtained results are then operated via morphological opening by reconstruction and closing by reconstruction to generate an improved feature set for classification. The HGFM features are input to an ensemble learning (EL) based on classification framework, in which EL plays an auxiliary role to enhance the classification stability and reliability. Three commonly used HSIs are used for experiments, and different feature sets are evaluated by comparing EL and rotation forest, support vector machine optimized by particle swarm optimization, random forest, and others. Compared with benchmark feature sets, the proposed HGFM feature set can better depict the details of objects easily, and the experimental results confirm the effectiveness in terms of classification accuracy and generalization ability.

[1]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[2]  Antonio Plaza,et al.  Portability Study of an OpenCL Algorithm for Automatic Target Detection in Hyperspectral Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Antonio J. Plaza,et al.  Learning Discriminative Sparse Representations for Hyperspectral Image Classification , 2015, IEEE Journal of Selected Topics in Signal Processing.

[4]  中村明弘.  Guided Image Filtering の臨床 PET 画像への応用の試み , 2015 .

[5]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification With Edge-Preserving Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Abdulhamit Subasi,et al.  Classification of EMG signals using PSO optimized SVM for diagnosis of neuromuscular disorders , 2013, Comput. Biol. Medicine.

[7]  Yunsong Li,et al.  Structure Tensor and Guided Filtering-Based Algorithm for Hyperspectral Anomaly Detection , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[9]  D. Wolpert.  The Supervised Learning No-Free-Lunch Theorems , 2002 .

[10]  D. Farina,et al.  Linear and Nonlinear Regression Techniques for Simultaneous and Proportional Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  M.,et al.  Statistical and Structural Approaches to Texture , 2022 .

[12]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Erzhu Li,et al.  Advances of Four Machine Learning Methods for Spatial Data Handling: a Review , 2020, Journal of Geovisualization and Spatial Analysis.

[14]  Jon Atli Benediktsson,et al.  Support Tensor Machines for Classification of Hyperspectral Remote Sensing Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[16]  J. Dubois,et al.  Evaluation Of The Grey-level Co-occurrence Matrix Method For Land-cover Classification Using Spot Imagery , 1990 .

[17]  Sen Jia,et al.  Gabor Feature-Based Collaborative Representation for Hyperspectral Imagery Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Naoto Yokoya,et al.  Random Forest Ensembles and Extended Multiextinction Profiles for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Maryam Imani,et al.  Edge-preserving-based collaborative representation for spectral-spatial classification , 2017 .

[20]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[21]  Yongyang Xu,et al.  Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters , 2018, Remote. Sens..

[22]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Carlo Gatta,et al.  Unsupervised Deep Feature Extraction for Remote Sensing Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Ponnuthurai N. Suganthan,et al.  Ensemble Classification and Regression-Recent Developments, Applications and Future Directions [Review Article] , 2016, IEEE Computational Intelligence Magazine.

[25]  Min Li,et al.  Sparse and Low-Rank Coupling Image Segmentation Model Via Nonconvex Regularization , 2015, Int. J. Pattern Recognit. Artif. Intell..

[26]  Julio Barros,et al.  Analysis of Harmonics in Power Systems Using the Wavelet-Packet Transform , 2005, IEEE Transactions on Instrumentation and Measurement.

[27]  Jon Atli Benediktsson,et al.  Multiple Spectral–Spatial Classification Approach for Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Jon Atli Benediktsson,et al.  Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Nur Hüseyin Kaplan,et al.  Remote Sensing Image Enhancement via Robust Guided Filtering , 2019, 2019 9th International Conference on Recent Advances in Space Technologies (RAST).

[30]  Lianru Gao,et al.  A New Low-Rank Representation Based Hyperspectral Image Denoising Method for Mineral Mapping , 2017, Remote. Sens..

[31]  Peijun Du,et al.  Combining Rotation Forest and Multiscale Segmentation for the Classification of Hyperspectral Data , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Liangpei Zhang,et al.  An Adaptive Multiscale Information Fusion Approach for Feature Extraction and Classification of IKONOS Multispectral Imagery Over Urban Areas , 2007, IEEE Geoscience and Remote Sensing Letters.

[33]  Zhenyu Lu,et al.  Spectral–spatial hyperspectral image classification with adaptive mean filter and jump regression detection , 2015 .

[34]  Hassan Ghassemian,et al.  Multiscale Gaussian Derivative Functions for Hyperspectral Image Feature Extraction , 2016, IEEE Geoscience and Remote Sensing Letters.

[35]  Jon Atli Benediktsson,et al.  Classification of Hyperspectral Images by Using Extended Morphological Attribute Profiles and Independent Component Analysis , 2011, IEEE Geoscience and Remote Sensing Letters.

[36]  Patrick Matgen,et al.  Flood detection from multi-temporal SAR data using harmonic analysis and change detection , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[37]  Qing Zhu,et al.  Feature extraction method based on spectral dimensional edge preservation filtering for hyperspectral image classification , 2020, International Journal of Remote Sensing.

[38]  Johannes R. Sveinsson,et al.  Classification of hyperspectral data from urban areas based on extended morphological profiles , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[39]  Peijun Du,et al.  Spectral–Spatial Classification for Hyperspectral Data Using Rotation Forests With Local Feature Extraction and Markov Random Fields , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[41]  William J. Emery,et al.  Classification of Very High Spatial Resolution Imagery Using Mathematical Morphology and Support Vector Machines , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Russell M. Mersereau,et al.  On the impact of PCA dimension reduction for hyperspectral detection of difficult targets , 2005, IEEE Geoscience and Remote Sensing Letters.

[43]  Jon Atli Benediktsson,et al.  A Survey on Spectral–Spatial Classification Techniques Based on Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[44]  Qian Du,et al.  Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network , 2018, IEEE Geoscience and Remote Sensing Letters.

[45]  João Gama,et al.  Ensemble learning for data stream analysis: A survey , 2017, Inf. Fusion.

[46]  Layne T. Watson,et al.  An Adaptive Noise-Filtering Algorithm for AVIRIS Data With Implications for Classification Accuracy , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[47]  J. Chanussot,et al.  Hyperspectral Remote Sensing Data Analysis and Future Challenges , 2013, IEEE Geoscience and Remote Sensing Magazine.

[48]  Hossein Karshenas,et al.  KNN-based multi-label twin support vector machine with priority of labels , 2018, Neurocomputing.

[49]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[50]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Peijun Du,et al.  Hyperspectral Remote Sensing Image Classification Based on Rotation Forest , 2014, IEEE Geoscience and Remote Sensing Letters.

[52]  Naoto Yokoya,et al.  Direct, ECOC, ND and END Frameworks - Which One Is the Best? An Empirical Study of Sentinel-2A MSIL1C Image Classification for Arid-Land Vegetation Mapping in the Ili River Delta, Kazakhstan , 2019, Remote. Sens..

[53]  Massimo Menenti,et al.  Reconstruction of global MODIS NDVI time series: performance of harmonic analysis of time series (HANTS). , 2015 .

[54]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[55]  Lifu Zhang,et al.  Progress in Hyperspectral Remote Sensing Science and Technology in China Over the Past Three Decades , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[56]  J. Benediktsson,et al.  New Frontiers in Spectral-Spatial Hyperspectral Image Classification: The Latest Advances Based on Mathematical Morphology, Markov Random Fields, Segmentation, Sparse Representation, and Deep Learning , 2018, IEEE Geoscience and Remote Sensing Magazine.

[57]  Jon Atli Benediktsson,et al.  Segmentation and Classification of Hyperspectral Images Using Minimum Spanning Forest Grown From Automatically Selected Markers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[58]  Leonhard Blesius,et al.  Tree Species Classification Using Hyperspectral Imagery: A Comparison of Two Classifiers , 2016, Remote. Sens..

[59]  Digvir S. Jayas,et al.  Hyperspectral imaging to classify and monitor quality of agricultural materials , 2015 .

[60]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Wei Zhang,et al.  Multiple Classifier System for Remote Sensing Image Classification: A Review , 2012, Sensors.

[62]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[63]  V. M. Chowdary,et al.  Forest health assessment for geo-environmental planning and management in hilltop mining areas using Hyperion and Landsat data , 2019, Ecological Indicators.

[64]  Gang Yang,et al.  A Moving Weighted Harmonic Analysis Method for Reconstructing High-Quality SPOT VEGETATION NDVI Time-Series Data , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[65]  Jon Atli Benediktsson,et al.  Recent Advances in Techniques for Hyperspectral Image Processing , 2009 .

[66]  Zhaohui Xue,et al.  Harmonic Analysis for Hyperspectral Image Classification Integrated With PSO Optimized SVM , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[67]  Curtis E. Woodcock,et al.  Improved change monitoring using an ensemble of time series algorithms , 2020 .

[68]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[69]  Jon Atli Benediktsson,et al.  Multiple Feature Learning for Hyperspectral Image Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.