Mapping Heterogeneous Urban Landscapes from the Fusion of Digital Surface Model and Unmanned Aerial Vehicle-Based Images Using Adaptive Multiscale Image Segmentation and Classification

Considering the high-level details in an ultrahigh-spatial-resolution (UHSR) unmanned aerial vehicle (UAV) dataset, detailed mapping of heterogeneous urban landscapes is extremely challenging because of the spectral similarity between classes. In this study, adaptive hierarchical image segmentation optimization, multilevel feature selection, and multiscale (MS) supervised machine learning (ML) models were integrated to accurately generate detailed maps for heterogeneous urban areas from the fusion of the UHSR orthomosaic and digital surface model (DSM). The integrated approach commenced through a preliminary MS image segmentation parameter selection, followed by the application of three supervised ML models, namely, random forest (RF), support vector machine (SVM), and decision tree (DT). These models were implemented at the optimal MS levels to identify preliminary information, such as the optimal segmentation level(s) and relevant features, for extracting 12 land use/land cover (LULC) urban classes from the fused datasets. Using the information obtained from the first phase of the analysis, detailed MS classification was iteratively conducted to improve the classification accuracy and derive the final urban LULC maps. Two UAV-based datasets were used to develop and assess the effectiveness of the proposed framework. The hierarchical classification of the pilot study area showed that the RF was superior with an overall accuracy (OA) of 94.40% and a kappa coefficient (K) of 0.938, followed by SVM (OA = 92.50% and K = 0.917) and DT (OA = 91.60% and K = 0.908). The classification results of the second dataset revealed that SVM was superior with an OA of 94.45% and K of 0.938, followed by RF (OA = 92.46% and K = 0.916) and DT (OA = 90.46% and K = 0.893). The proposed framework exhibited an excellent potential for the detailed mapping of heterogeneous urban landscapes from the fusion of UHSR orthophoto and DSM images using various ML models.

[1]  Mohamed Barakat A. Gibril,et al.  Synergistic use of particle swarm optimization, artificial neural network, and extreme gradient boosting algorithms for urban LULC mapping from WorldView-3 images , 2020, Geocarto International.

[2]  Liang Xiao,et al.  Optimizing multiscale segmentation with local spectral heterogeneity measure for high resolution remote sensing images , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[3]  Bahareh Kalantar,et al.  Multi-scale correlation-based feature selection and random forest classification for LULC mapping from the integration of SAR and optical Sentinel images , 2019, Remote Sensing.

[4]  Ying Liu,et al.  Unsupervised segmentation parameter selection using the local spatial statistics for remote sensing image segmentation , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[5]  Muhammad Kamal,et al.  Geographic Object Based Image Analysis (GEOBIA) for Mangrove Canopy Delineation Using Aerial Photography , 2019, IOP Conference Series: Earth and Environmental Science.

[6]  Bahareh Kalantar,et al.  Land Cover Classification from fused DSM and UAV Images Using Convolutional Neural Networks , 2019, Remote. Sens..

[7]  Rasmus Fensholt,et al.  Geographic Object Based Image Analysis of WorldView-3 Imagery for Urban Hydrologic Modelling at the Catchment Scale , 2019, Water.

[8]  Abdallah Shanableh,et al.  Spatiotemporal Mapping and Monitoring of Whiting in the Semi-Enclosed Gulf Using Moderate Resolution Imaging Spectroradiometer (MODIS) Time Series Images and a Generic Ensemble Tree-Based Model , 2019, Remote. Sens..

[9]  Xing Liu,et al.  A Land Cover Refined Classification Method Based on the Fusion of LiDAR Data and UAV Image , 2019, Proceedings of the 2019 International Conference on Computer, Network, Communication and Information Systems (CNCI 2019).

[10]  C. Giupponi,et al.  Combining LULC data and agricultural statistics for A better identification and mapping of High nature value farmland: A case study in the veneto Plain, Italy , 2019, Land Use Policy.

[11]  Caspar A. Mücher,et al.  SegOptim - A new R package for optimizing object-based image analyses of high-spatial resolution remotely-sensed data , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[12]  Alireza Hamedianfar,et al.  Large-scale urban mapping using integrated geographic object-based image analysis and artificial bee colony optimization from worldview-3 data , 2019, International Journal of Remote Sensing.

[13]  Sabine Vanhuysse,et al.  Fully Convolutional Networks and Geographic Object-Based Image Analysis for the Classification of VHR Imagery , 2019, Remote. Sens..

[14]  Ming Shang,et al.  Object-based image analysis of suburban landscapes using Landsat-8 imagery , 2018, Int. J. Digit. Earth.

[15]  Ashton Shortridge,et al.  UAS-GEOBIA Approach to Sapling Identification in Jack Pine Barrens after Fire , 2018, Drones.

[16]  Rui Hu,et al.  Multiscale Optimized Segmentation of Urban Green Cover in High Resolution Remote Sensing Image , 2018, Remote. Sens..

[17]  Niti B. Mishra,et al.  Species-Level Vegetation Mapping in a Himalayan Treeline Ecotone Using Unmanned Aerial System (UAS) Imagery , 2018, ISPRS Int. J. Geo Inf..

[18]  Abdallah Shanableh,et al.  Image Segmentation Parameter Selection and Ant Colony Optimization for Date Palm Tree Detection and Mapping from Very-High-Spatial-Resolution Aerial Imagery , 2018, Remote. Sens..

[19]  Jan Komárek,et al.  The potential of Unmanned Aerial Systems: A tool towards precision classification of hard-to-distinguish vegetation types? , 2018, Int. J. Appl. Earth Obs. Geoinformation.

[20]  Biswajeet Pradhan,et al.  An improved algorithm for identifying shallow and deep-seated landslides in dense tropical forest from airborne laser scanning data , 2018, CATENA.

[21]  A. Curtis,et al.  The land use suitability concept: Introduction and an application of the concept to inform sustainable productivity within environmental constraints , 2018, Ecological Indicators.

[22]  Yuhong He,et al.  High Spatial Resolution Remote Sensing , 2018 .

[23]  Jian Yang,et al.  Region Merging Considering Within- and Between-Segment Heterogeneity: An Improved Hybrid Remote-Sensing Image Segmentation Method , 2018, Remote. Sens..

[24]  Ö. Akar The Rotation Forest algorithm and object-based classification method for land use mapping through UAV images , 2018 .

[25]  Haiyan Gu,et al.  An Efficient Parallel Multi-Scale Segmentation Method for Remote Sensing Imagery , 2018, Remote. Sens..

[26]  Qiusheng Wu,et al.  Decision-Tree, Rule-Based, and Random Forest Classification of High-Resolution Multispectral Imagery for Wetland Mapping and Inventory , 2018, Remote. Sens..

[27]  Qiuyan Yu,et al.  Land use/cover change in Ghana’s oil city: Assessing the impact of neoliberal economic policies and implications for sustainable development goal number one – A remote sensing and GIS approach , 2018 .

[28]  Mohamed Barakat A. Gibril,et al.  Integrative image segmentation optimization and machine learning approach for high quality land-use and land-cover mapping using multisource remote sensing data , 2018 .

[29]  Jorge Torres-Sánchez,et al.  An Automatic Random Forest-OBIA Algorithm for Early Weed Mapping between and within Crop Rows Using UAV Imagery , 2018, Remote. Sens..

[30]  Lin Liu,et al.  Object-Based Mangrove Species Classification Using Unmanned Aerial Vehicle Hyperspectral Images and Digital Surface Models , 2018, Remote. Sens..

[31]  Takashi Matsubara,et al.  Advantages of unmanned aerial vehicle (UAV) photogrammetry for landscape analysis compared with satellite data: A case study of postmining sites in Indonesia , 2018 .

[32]  Helmi Zulhaidi Mohd Shafri,et al.  Road condition assessment by OBIA and feature selection techniques using very high-resolution WorldView-2 imagery , 2017 .

[33]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[34]  Taskin Kavzoglu,et al.  A comparative study of segmentation quality for multi-resolution segmentation and watershed transform , 2017, 2017 8th International Conference on Recent Advances in Space Technologies (RAST).

[35]  Bahareh Kalantar,et al.  Performance Evaluation and Sensitivity Analysis of Expert-Based, Statistical, Machine Learning, and Hybrid Models for Producing Landslide Susceptibility Maps , 2017 .

[36]  S. Franklin,et al.  Hierarchical land cover and vegetation classification using multispectral data acquired from an unmanned aerial vehicle , 2017 .

[37]  Bahareh Kalantar,et al.  Drone-based land-cover mapping using a fuzzy unordered rule induction algorithm integrated into object-based image analysis , 2017 .

[38]  Qing Wang,et al.  Object-Based Land-Cover Supervised Classification for Very-High-Resolution UAV Images Using Stacked Denoising Autoencoders , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Thomas Blaschke,et al.  Evaluation of Feature Selection Methods for Object-Based Land Cover Mapping of Unmanned Aerial Vehicle Imagery Using Random Forest and Support Vector Machine Classifiers , 2017, ISPRS Int. J. Geo Inf..

[40]  R. Congalton,et al.  A comparison of unsupervised segmentation parameter optimization approaches using moderate- and high-resolution imagery , 2017 .

[41]  Özlem Akar,et al.  Mapping land use with using Rotation Forest algorithm from UAV images , 2017 .

[42]  Bogdan Zagajewski,et al.  Comparison of support vector machine, random forest and neural network classifiers for tree species classification on airborne hyperspectral APEX images , 2017 .

[43]  Biswajeet Pradhan,et al.  Laser Scanning Applications in Landslide Assessment , 2017 .

[44]  Jie Tian,et al.  Random Forest Classification of Wetland Landcovers from Multi-Sensor Data in the Arid Region of Xinjiang, China , 2016, Remote. Sens..

[45]  Emanuele Frontoni,et al.  A multi/hyper-spectral imaging system for land use/land cover using unmanned aerial systems , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[46]  Shihong Du,et al.  Learning selfhood scales for urban land cover mapping with very-high-resolution satellite images , 2016 .

[47]  Helmi Zulhaidi Mohd Shafri,et al.  Integrated approach using data mining-based decision tree and object-based image analysis for high-resolution urban mapping of WorldView-2 satellite sensor data , 2016 .

[48]  Isao Endo,et al.  Image Segmentation Parameter Optimization Considering Within- and Between-Segment Heterogeneity at Multiple Scale Levels: Test Case for Mapping Residential Areas Using Landsat Imagery , 2015, ISPRS Int. J. Geo Inf..

[49]  Min Zhang,et al.  Scale parameter selection by spatial statistics for GeOBIA: Using mean-shift based multi-scale segmentation as an example , 2015 .

[50]  Alexander Brenning,et al.  Evaluating machine learning and statistical prediction techniques for landslide susceptibility modeling , 2015, Comput. Geosci..

[51]  Koreen Millard,et al.  On the Importance of Training Data Sample Selection in Random Forest Image Classification: A Case Study in Peatland Ecosystem Mapping , 2015, Remote. Sens..

[52]  Abbas Alimohammadi,et al.  Land cover mapping based on random forest classification of multitemporal spectral and thermal images , 2015, Environmental Monitoring and Assessment.

[53]  Stuart R. Phinn,et al.  Object-Based Approach for Multi-Scale Mangrove Composition Mapping Using Multi-Resolution Image Datasets , 2015, Remote. Sens..

[54]  Qihao Weng,et al.  An Automated Method to Parameterize Segmentation Scale by Enhancing Intrasegment Homogeneity and Intersegment Heterogeneity , 2015, IEEE Geoscience and Remote Sensing Letters.

[55]  K. Moffett,et al.  Remote Sens , 2015 .

[56]  Yunjun Yao,et al.  Use of UAV oblique imaging for the detection of individual trees in residential environments , 2015 .

[57]  Djamel Bouchaffra,et al.  Pixel-based or Object-based: Which approach is more appropriate for remote sensing image classification? , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[58]  Jian Yang,et al.  A multi-band approach to unsupervised scale parameter selection for multi-scale image segmentation , 2014 .

[59]  Wenkai Li,et al.  A New Accuracy Assessment Method for One-Class Remote Sensing Classification , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[60]  O. Csillik,et al.  Automated parameterisation for multi-scale image segmentation on multiple layers , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[61]  B. Taner San,et al.  An evaluation of SVM using polygon-based random sampling in landslide susceptibility mapping: The Candir catchment area (western Antalya, Turkey) , 2014, Int. J. Appl. Earth Obs. Geoinformation.

[62]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[63]  Simon Fong,et al.  Selecting Optimal Feature Set in High-Dimensional Data by Swarm Search , 2013, J. Appl. Math..

[64]  Ana-Maria Cretu,et al.  Building Detection in Aerial Images Based on Watershed and Visual Attention Feature Descriptors , 2013, 2013 International Conference on Computer and Robot Vision.

[65]  Jon Atli Benediktsson,et al.  A Novel Technique for Optimal Feature Selection in Attribute Profiles Based on Genetic Algorithms , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[66]  Tapas Ranjan Martha,et al.  Segment Optimization and Data-Driven Thresholding for Knowledge-Based Landslide Detection by Object-Based Image Analysis , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[68]  Guifeng Zhang,et al.  An Edge Embedded Marker-Based Watershed Algorithm for High Spatial Resolution Remote Sensing Image Segmentation , 2010, IEEE Transactions on Image Processing.

[69]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[70]  C. Unsalan,et al.  Building detection from aerial images using invariant color features and shadow information , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[71]  Thomas Blaschke,et al.  Object-Based Image Analysis , 2008 .

[72]  Antônio Miguel Vieira Monteiro,et al.  Parameter selection for region‐growing image segmentation algorithms using spatial autocorrelation , 2006 .

[73]  R. Reedy,et al.  Impact of land use and land cover change on groundwater recharge and quality in the southwestern US , 2005 .

[74]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[75]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[76]  Geoff Holmes,et al.  Benchmarking Attribute Selection Techniques for Discrete Class Data Mining , 2003, IEEE Trans. Knowl. Data Eng..

[77]  Paul M. Mather,et al.  An assessment of the effectiveness of decision tree methods for land cover classification , 2003 .

[78]  Thomas Glade,et al.  Landslide occurrence as a response to land use change: a review of evidence from New Zealand , 2003 .

[79]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[80]  Paul M. Mather,et al.  DECISION TREE BASED CLASSIFICATION OF REMOTELY SENSED DATA , 2001 .

[81]  M. Charlton,et al.  Quantitative geography : perspectives on spatial data analysis by , 2001 .

[82]  Arnold W. M. Smeulders,et al.  PicToSeek: combining color and shape invariant features for image retrieval , 2000, IEEE Trans. Image Process..

[83]  Lloyd A. Smith,et al.  Practical feature subset selection for machine learning , 1998 .

[84]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[85]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..