Gradient Boosting Machine and Object-Based CNN for Land Cover Classification

In regular convolutional neural networks (CNN), fully-connected layers act as classifiers to estimate the probabilities for each instance in classification tasks. The accuracy of CNNs can be improved by replacing fully connected layers with gradient boosting algorithms. In this regard, this study investigates three robust classifiers, namely XGBoost, LightGBM, and Catboost, in combination with a CNN for a land cover study in Hanoi, Vietnam. The experiments were implemented using SPOT7 imagery through (1) image segmentation and extraction of features, including spectral information and spatial metrics, (2) normalization of attribute values and generation of graphs, and (3) using graphs as the input dataset to the investigated models for classifying six land cover classes, namely House, Bare land, Vegetation, Water, Impervious Surface, and Shadow. The results show that CNN-based XGBoost (Overall accuracy = 0.8905), LightGBM (0.8956), and CatBoost (0.8956) outperform the other methods used for comparison. It can be seen that the combination of object-based image analysis and CNN-based gradient boosting algorithms significantly improves classification accuracies and can be considered as alternative methods for land cover analysis.

[1]  Jianhua Li,et al.  A Novel Image Classification Method with CNN-XGBoost Model , 2017, IWDW.

[2]  Benjamin M. Jones,et al.  Understanding the Effects of Optimal Combination of Spectral Bands on Deep Learning Model Predictions: A Case Study Based on Permafrost Tundra Landform Mapping Using High Resolution Multispectral Satellite Imagery , 2020, J. Imaging.

[3]  S. Lang,et al.  Mask R‐CNN‐based building extraction from VHR satellite data in operational humanitarian action: An example related to Covid‐19 response in Khartoum, Sudan , 2021, Trans. GIS.

[4]  Quang-Thanh Bui,et al.  Whale Optimization Algorithm and Adaptive Neuro-Fuzzy Inference System: a hybrid method for feature selection and land pattern classification , 2019, International Journal of Remote Sensing.

[5]  Xia Li,et al.  Integration of Convolutional Neural Networks and Object-Based Post-Classification Refinement for Land Use and Land Cover Mapping with Optical and SAR Data , 2019, Remote. Sens..

[6]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[7]  Xiuwen Liu,et al.  A patch-based convolutional neural network for remote sensing image classification , 2017, Neural Networks.

[8]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[9]  Dongmei Chen,et al.  Comparing Deep Neural Networks, Ensemble Classifiers, and Support Vector Machine Algorithms for Object-Based Urban Land Use/Land Cover Classification , 2019, Remote. Sens..

[10]  Elif Sertel,et al.  Single-frame super resolution of remote-sensing images by convolutional neural networks , 2018 .

[11]  Panagiotis Tsakalides,et al.  Survey of Deep-Learning Approaches for Remote Sensing Observation Enhancement , 2019, Sensors.

[12]  Giuseppe Scarpa,et al.  A CNN-Based Fusion Method for Feature Extraction from Sentinel Data , 2018, Remote. Sens..

[13]  Saifur Rahman,et al.  Performance Analysis of Boosting Classifiers in Recognizing Activities of Daily Living , 2020, International journal of environmental research and public health.

[14]  Dongping Ming,et al.  CNN-based Land Cover Classification Combining Stratified Segmentation and Fusion of Point Cloud and Very High-Spatial Resolution Remote Sensing Image Data , 2019, Remote. Sens..

[15]  Haohui Chen,et al.  A Novel Framework Based on Mask R-CNN and Histogram Thresholding for Scalable Segmentation of New and Old Rural Buildings , 2021, Remote. Sens..

[16]  Damir Medak,et al.  Support Vector Machine Accuracy Assessment for Extracting Green Urban Areas in Towns , 2019, Remote. Sens..

[17]  Xuan Linh Nguyen,et al.  A Novel Method for Multispectral Image Classification by Using Social Spider Optimization Algorithm Integrated to Fuzzy C-Mean Clustering , 2019, Canadian Journal of Remote Sensing.

[18]  Moumen T. El-Melegy,et al.  Neural Networks in Multiple Classifier Systems for Remote-Sensing Image Classification , 2007 .

[19]  Devis Tuia,et al.  Understanding urban landuse from the above and ground perspectives: a deep learning, multimodal solution , 2019, Remote Sensing of Environment.

[20]  Xiangyun Hu,et al.  Deep-Learning-Based Classification for DTM Extraction from ALS Point Cloud , 2016, Remote. Sens..

[21]  Shawn D. Newsam,et al.  Learning Low Dimensional Convolutional Neural Networks for High-Resolution Remote Sensing Image Retrieval , 2016, Remote. Sens..

[22]  Michele Volpi,et al.  Land cover mapping at very high resolution with rotation equivariant CNNs: towards small yet accurate models , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[23]  Jie Tian,et al.  Random Forest Classification of Wetland Landcovers from Multi-Sensor Data in the Arid Region of Xinjiang, China , 2016, Remote. Sens..

[24]  Xin Pan,et al.  An object-based convolutional neural network (OCNN) for urban land use classification , 2018, Remote Sensing of Environment.

[25]  Xiuwen Liu,et al.  Land Cover Classification from Multi-temporal, Multi-spectral Remotely Sensed Imagery using Patch-Based Recurrent Neural Networks , 2017, Neural Networks.

[26]  Yuqi Bai,et al.  Annual dynamics of global land cover and its long-term changes from 1982 to 2015 , 2020, Earth System Science Data.

[27]  Meenakshisundaram Gopi,et al.  Optimized Multi-Spectral Filter Array Based Imaging of Natural Scenes , 2018, Sensors.

[28]  D. Koundal,et al.  Image Fusion Techniques: A Survey , 2021, Archives of computational methods in engineering : state of the art reviews.

[29]  Jie Shan,et al.  A genetic algorithm solution to the gram-schmidt image fusion , 2019, International Journal of Remote Sensing.

[30]  Myung-Jin Jun,et al.  A comparison of a gradient boosting decision tree, random forests, and artificial neural networks to model urban land use changes: the case of the Seoul metropolitan area , 2021, Int. J. Geogr. Inf. Sci..

[31]  Junghye Lee,et al.  Different Spectral Domain Transformation for Land Cover Classification Using Convolutional Neural Networks with Multi-Temporal Satellite Imagery , 2020, Remote. Sens..

[32]  Elfatih M. Abdel-Rahman,et al.  Color Calibration of Proximal Sensing RGB Images of Oilseed Rape Canopy via Deep Learning Combined with K-Means Algorithm , 2019, Remote. Sens..

[33]  Ying Wang,et al.  Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images , 2017, Remote. Sens..

[34]  Yang Song,et al.  Remote Sensing Image Classification Based on SVM and Object Semantic , 2013, GRMSE.

[35]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[36]  Sabine Vanhuysse,et al.  Fully Convolutional Networks and Geographic Object-Based Image Analysis for the Classification of VHR Imagery , 2019, Remote. Sens..

[37]  W. Zeng,et al.  Evaluation of CatBoost method for prediction of reference evapotranspiration in humid regions , 2019, Journal of Hydrology.

[38]  Qiangqiang Yuan,et al.  Thick cloud and cloud shadow removal in multitemporal imagery using progressively spatio-temporal patch group deep learning , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[39]  Van-Manh Pham,et al.  Hybrid model to optimize object-based land cover classification by meta-heuristic algorithm: an example for supporting urban management in Ha Noi, Viet Nam , 2018, Int. J. Digit. Earth.

[40]  Ji Hyun Park,et al.  RGB Image Prioritization Using Convolutional Neural Network on a Microprocessor for Nanosatellites , 2020, Remote. Sens..