Context-Enabled Extraction of Large-Scale Urban Functional Zones from Very-High-Resolution Images: A Multiscale Segmentation Approach

Urban functional-zone (UFZ) analysis has been widely used in many applications, including urban environment evaluation, and urban planning and management. How to extract UFZs’ spatial units which delineates UFZs’ boundaries is fundamental to urban applications, but it is still unresolved. In this study, an automatic, context-enabled multiscale image segmentation method is proposed for extracting spatial units of UFZs from very-high-resolution satellite images. First, a window independent context feature is calculated to measure context information in the form of geographic nearest-neighbor distance from a pixel to different image classes. Second, a scale-adaptive approach is proposed to determine appropriate scales for each UFZ in terms of its context information and generate the initial UFZs. Finally, the graph cuts algorithm is improved to optimize the initial UFZs. Two datasets including WorldView-2 image in Beijing and GaoFen-2 image in Nanchang are used to evaluate the proposed method. The results indicate that the proposed method can generate better results from very-high-resolution satellite images than widely used approaches like image tiles and road blocks in representing UFZs. In addition, the proposed method outperforms existing methods in both segmentation quality and running time. Therefore, the proposed method appears to be promising and practical for segmenting large-scale UFZs.

[1]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Lei Guo,et al.  Remote Sensing Image Scene Classification Using Bag of Convolutional Features , 2017, IEEE Geoscience and Remote Sensing Letters.

[3]  Michael Meinild Nielsen,et al.  Remote sensing for urban planning and management: The use of window-independent context segmentation to extract urban features in Stockholm , 2015, Comput. Environ. Urban Syst..

[4]  Steven E. Franklin,et al.  A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery , 2012 .

[5]  Ola Ahlqvist,et al.  Classification of different urban categories corresponding to the strategic spatial level of urban planning and management using a SPOT4 scene , 2015 .

[6]  Hui Xiong,et al.  Discovering Urban Functional Zones Using Latent Activity Trajectories , 2015, IEEE Transactions on Knowledge and Data Engineering.

[7]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[8]  Shihong Du,et al.  Semantic Classification of Heterogeneous Urban Scenes Using Intrascene Feature Similarity and Interscene Semantic Dependency , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Catherine Linard,et al.  Improving Urban Population Distribution Models with Very-High Resolution Satellite Information , 2019, Data.

[10]  Thomas Kirchhoff,et al.  What is Landscape Ecology? An Analysis and Evaluation of Six Different Conceptions , 2013 .

[11]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jian Yang,et al.  Region merging using local spectral angle thresholds: A more accurate method for hybrid segmentation of remote sensing images , 2017 .

[13]  Xin Du,et al.  The Combined Use of Remote Sensing and Social Sensing Data in Fine-Grained Urban Land Use Mapping: A Case Study in Beijing, China , 2017, Remote. Sens..

[14]  T. Esch,et al.  Urban structure type characterization using hyperspectral remote sensing and height information , 2012 .

[15]  Vinayadatt V Kohir,et al.  Level set issues for efficient image segmentation , 2011 .

[16]  Geoffrey J. Hay,et al.  Geographic Object-Based Image Analysis (GEOBIA): A new name for a new discipline , 2008 .

[17]  Shihong Du,et al.  Scene classification using multi-scale deeply described visual words , 2016 .

[18]  Zhiwu Lu,et al.  Zero-Shot Scene Classification for High Spatial Resolution Remote Sensing Images , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Shougeng Hu,et al.  Automated urban land-use classification with remote sensing , 2013 .

[20]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[21]  Brian Johnson,et al.  Unsupervised image segmentation evaluation and refinement using a multi-scale approach , 2011 .

[22]  Biswajeet Pradhan,et al.  A comparative assessment between object and pixel-based classification approaches for land use/land cover mapping using SPOT 5 imagery , 2014 .

[23]  Jian Peng,et al.  Urban thermal environment dynamics and associated landscape pattern factors: A case study in the Beijing metropolitan region , 2016 .

[24]  Hurtado Abril,et al.  Generación de un índice espectro-temporal para la identificación de zonas afectadas por deforestación usando imágenes Landsat. , 2020 .

[25]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[26]  Hong Zhang,et al.  An evaluation metric for image segmentation of multiple objects , 2009, Image Vis. Comput..

[27]  Xueliang Zhang,et al.  Hybrid region merging method for segmentation of high-resolution remote sensing images , 2014 .

[28]  E. Lynn Usery,et al.  Using Geometrical, Textural, and Contextual Information of Land Parcels for Classification of Detailed Urban Land Use , 2009 .

[29]  David M. Mount,et al.  A Fast Implementation of the Isodata Clustering Algorithm , 2007, Int. J. Comput. Geom. Appl..

[30]  Jian Yang,et al.  A discrepancy measure for segmentation evaluation from the perspective of object recognition , 2015 .

[31]  Shihong Du,et al.  Multiscale Geoscene Segmentation for Extracting Urban Functional Zones from VHR Satellite Images , 2018, Remote. Sens..

[32]  Ellen Banzhaf,et al.  Monitoring Urban Structure Types as Spatial Indicators With CIR Aerial Photographs for a More Effective Urban Environmental Management , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Thomas Blaschke,et al.  Object based image analysis for remote sensing , 2010 .

[34]  Yun Zhang,et al.  Semantic Segmentation of Remote Sensing Imagery Using an Object-Based Markov Random Field Model With Auxiliary Label Fields , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Peng Gong,et al.  Mapping Urban Land Use by Using Landsat Images and Open Social Data , 2016, Remote. Sens..

[36]  R. Kaplan,et al.  People needs in the urban landscape : Analysis of Landscape And Urban Planning contributions , 2008 .

[37]  Wei Tu,et al.  Portraying Urban Functional Zones by Coupling Remote Sensing Imagery and Human Sensing Data , 2018, Remote. Sens..

[38]  Sabine Vanhuysse,et al.  Normalization in Unsupervised Segmentation Parameter Optimization: A Solution Based on Local Regression Trend Analysis , 2018, Remote. Sens..

[39]  M. Herold,et al.  Spatial Metrics and Image Texture for Mapping Urban Land Use , 2003 .

[40]  Pierre Alliez,et al.  Convolutional Neural Networks for Large-Scale Remote-Sensing Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Shihong Du,et al.  Learning selfhood scales for urban land cover mapping with very-high-resolution satellite images , 2016 .

[42]  Geoffrey J. Hay,et al.  Geographic object-based image analysis (GEOBIA): emerging trends and future opportunities , 2018 .

[43]  Domenec Puig,et al.  Focus-aided scene segmentation , 2015, Comput. Vis. Image Underst..

[44]  Christian Berger,et al.  Satellite Remote Sensing of Surface Urban Heat Islands: Progress, Challenges, and Perspectives , 2018, Remote. Sens..

[45]  Bo Du,et al.  Unsupervised Scene Change Detection via Latent Dirichlet Allocation and Multivariate Alteration Detection , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.