A Novel Feature Fusion Approach for VHR Remote Sensing Image Classification

This article develops a robust feature fusion approach to enhance the classification performance of very high resolution (VHR) remote sensing images. Specifically, a novel two-stage multiple feature fusion (TsF) approach is proposed, which includes an intragroup and an intergroup feature fusion stages. In the first fusion stage, multiple features are grouped by clustering, where redundant information between different types of features is eliminated within each group. Then, features are pairwisely fused in an intergroup fusion model based on the guided filtering method. Finally, the fused feature set is imported into a classifier to generate the classification map. In this work, the original VHR spectral bands and their attribute profiles are taken as examples as input spectral and spatial features, respectively, in order to test the performance of the proposed TsF approach. Experimental results obtained on two QuickBird datasets covering complex urban scenarios demonstrate the effectiveness of the proposed approach in terms of generation of more discriminative fusion features and enhancing classification performance. More importantly, the fused feature dimensionality is limited at a certain level; thus, the computational cost will not be significantly increased even if multiple features are considered.

[1]  Kai Feng,et al.  Spatial-spectral multiple kernel learning for hyperspectral image classification , 2013, 2013 5th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).

[2]  Feiniu Yuan,et al.  Remote Sensing Image Fusion Based on Adaptive IHS and Multiscale Guided Filter , 2016, IEEE Access.

[3]  Jon Atli Benediktsson,et al.  Change Detection in VHR Images Based on Morphological Attribute Profiles , 2013, IEEE Geoscience and Remote Sensing Letters.

[4]  Sicong Liu,et al.  A Multisource Remotely Sensed Data Oriented Method for “Ghost City” Phenomenon Identification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Jinye Peng,et al.  Spectral-spatial hyperspectral image classification based on sparse representation and edge preserving filtering , 2017, 2017 International Conference on the Frontiers and Advances in Data Science (FADS).

[6]  Fang Liu,et al.  Mutual-Information-Based Semi-Supervised Hyperspectral Band Selection With High Discrimination, High Information, and Low Redundancy , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Sicong Liu,et al.  Classification of VHR Multispectral Images Using ExtraTrees and Maximally Stable Extremal Region-Guided Morphological Profile , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Chunsen Zhang,et al.  Spectral–Spatial Classification of Hyperspectral Images Using Probabilistic Weighted Strategy for Multifeature Fusion , 2016, IEEE Geoscience and Remote Sensing Letters.

[9]  Qian Du,et al.  Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  Naoto Yokoya,et al.  More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Naoto Yokoya,et al.  An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing , 2018, IEEE Transactions on Image Processing.

[12]  Jiasong Zhu,et al.  Discriminative Gabor Feature Selection for Hyperspectral Image Classification , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  Lianru Gao,et al.  Graph Convolutional Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Fang Liu,et al.  Deep Multiscale Spectral-Spatial Feature Fusion for Hyperspectral Images Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Peijun Du,et al.  Information fusion techniques for change detection from multi-temporal remote sensing images , 2013, Inf. Fusion.

[16]  Francesca Bovolo,et al.  A Review of Change Detection in Multitemporal Hyperspectral Images: Current Techniques, Applications, and Challenges , 2019, IEEE Geoscience and Remote Sensing Magazine.

[17]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[18]  Lei Shu,et al.  Learning Spatial–Spectral Features for Hyperspectral Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Vincent Barra,et al.  Fused 3-D spectral-spatial deep neural networks and spectral clustering for hyperspectral image classification , 2020, Pattern Recognit. Lett..

[20]  Jiancheng Luo,et al.  Geo-parcel-based crop classification in very-high-resolution images via hierarchical perception , 2020 .

[21]  Kai Yan,et al.  Species Discrimination of Plantations in Subtropical China Using 4-Band VHR Imagery and an Operational Image Analysis Framework , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Lorenzo Bruzzone,et al.  Earthquake Damage Assessment of Buildings Using VHR Optical and SAR Imagery , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Xiaohua Tong,et al.  A Multi-Scale Superpixel-Guided Filter Feature Extraction and Selection Approach for Classification of Very-High-Resolution Remotely Sensed Imagery , 2020, Remote. Sens..

[24]  Abdul Ghafoor,et al.  Guided Filter and IHS-Based Pan-Sharpening , 2016, IEEE Sensors Journal.

[25]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Lorenzo Bruzzone,et al.  Unsupervised Change Detection in Multispectral Remote Sensing Images via Spectral-Spatial Band Expansion , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Peijun Du,et al.  Fusion of Difference Images for Change Detection Over Urban Areas , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Saeid Homayouni,et al.  A Novel Multiple Kernel Learning Framework for Multiple Feature Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Sicong Liu,et al.  Change Detection Based on Low-Level to High-Level Features Integration With Limited Samples , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Liangpei Zhang,et al.  On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Jon Atli Benediktsson,et al.  Morphological Attribute Profiles for the Analysis of Very High Resolution Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Cong Lin,et al.  High-Resolution Imagery Classification Based on Different Levels of Information , 2019, Remote. Sens..