SO–CNN based urban functional zone fine division with VHR remote sensing image

Abstract Functional zone reflects city's spatial structures, and as a carrier of social and economic activities, it is of critical significance to urban management, resource allocation and planning. However, most researches on functional zone division are based on a large spatial scale such as blocks or other scales larger than it. Aiming at a subtle fine functional result, the concept of Super Object (SO) was especially explained, also a Super Object - Convolutional Neural Network (SO–CNN) based urban functional zone fine division method with very high resolution (VHR) remote sensing image was proposed. The original image was firstly segmented into different SOs which correspond to the basic functional zone units in geography. A random point generation algorithm was used to generate the voting points for functional zone category identification, and then a trained CNN model was employed to assign functional attributes to those voting points. Then a statistical method was involved to count the frequency of the classified voting points of different functional attributes in each basic functional zone units. By voting process, the functional attribute with the highest frequency was assigned to the basic functional zone unit, which corrected the misclassification results of CNN to some extent. This paper also explored the scale effect of the SO on the final functional zone classification result from two aspects, spatial scale of SO and the sampling window size of CNN model. Because of the natural differences between functional zone division and land cover classification, region based overall accuracy assessment method was used to evaluate functional zone division result. Compared with other methods, SO–CNN method can generate higher accuracy and subtle result, based on which larger spatial scale results can be available by scaling-up, so SO–CNN method plays a great significant role on small scale functional space structure research.

[1]  Shihong Du,et al.  Multiscale Geoscene Segmentation for Extracting Urban Functional Zones from VHR Satellite Images , 2018, Remote. Sens..

[2]  Francisco C. Pereira,et al.  Mining point-of-interest data from social networks for urban land use classification and disaggregation , 2015, Comput. Environ. Urban Syst..

[3]  Shihong Du,et al.  Hierarchical semantic cognition for urban functional zones with VHR satellite images and POI data , 2017 .

[4]  Dirk Tiede,et al.  ESP: a tool to estimate scale parameter for multiresolution image segmentation of remotely sensed data , 2010, Int. J. Geogr. Inf. Sci..

[5]  Jianguo Wu,et al.  A gradient analysis of urban landscape pattern: a case study from the Phoenix metropolitan region, Arizona, USA , 2004, Landscape Ecology.

[6]  The ecological play and the geological theater , 1996 .

[7]  Weiqi Zhou,et al.  Quantifying Spatial Heterogeneity in Urban Landscapes: Integrating Visual Interpretation and Object-Based Classification , 2014, Remote. Sens..

[8]  Jianguo Wu Urban ecology and sustainability: The state-of-the-science and future directions , 2014 .

[9]  Krzysztof Janowicz,et al.  Extracting urban functional regions from points of interest and human activities on location‐based social networks , 2017, Trans. GIS.

[10]  Xin Pan,et al.  An object-based convolutional neural network (OCNN) for urban land use classification , 2018, Remote Sensing of Environment.

[11]  S. Arlinghaus Fractals Take a Central Place , 1985 .

[12]  Yaolin Liu,et al.  Analyzing the Impacts of Urban Expansion on Green Fragmentation Using Constraint Gradient Analysis , 2017 .

[13]  Daniel Joly,et al.  Ecosystem Services Along the Urban-Rural-Natural Gradient: An Approach for a Wide Area Assessment and Mapping , 2015, ICCSA.

[14]  Peng Gong,et al.  Mapping Urban Land Use by Using Landsat Images and Open Social Data , 2016, Remote. Sens..

[15]  R. Kaplan,et al.  People needs in the urban landscape : Analysis of Landscape And Urban Planning contributions , 2008 .

[16]  Yao Shen,et al.  Urban function connectivity: Characterisation of functional urban streets with social media check-in data , 2016 .

[17]  Deren Li,et al.  Remote sensing monitoring of multi-scale watersheds impermeability for urban hydrological evaluation , 2019, Remote Sensing of Environment.

[18]  Wei Tu,et al.  Portraying Urban Functional Zones by Coupling Remote Sensing Imagery and Human Sensing Data , 2018, Remote. Sens..

[19]  M. Mcdonnell,et al.  The use of gradient analysis studies in advancing our understanding of the ecology of urbanizing landscapes: current status and future directions , 2008, Landscape Ecology.

[20]  Wei Ji,et al.  Characterizing urban sprawl using multi-stage remote sensing images and landscape metrics , 2006, Comput. Environ. Urban Syst..

[21]  M. Sigura,et al.  Landscape sequences along the urban–rural–natural gradient: A novel geospatial approach for identification and analysis , 2015 .

[22]  Tao Lin,et al.  Mapping Urban Functional Zones by Integrating Very High Spatial Resolution Remote Sensing Imagery and Points of Interest: A Case Study of Xiamen, China , 2018, Remote. Sens..

[23]  William J. Emery,et al.  Object-Based Convolutional Neural Network for High-Resolution Imagery Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Gu Ji-rong Spatial clustering algorithm on urban function oriented zone , 2011 .

[25]  Shihong Du,et al.  Integrating bottom-up classification and top-down feedback for improving urban land-cover and functional-zone mapping , 2018, Remote Sensing of Environment.

[26]  Shihong Du,et al.  Semantic Classification of Heterogeneous Urban Scenes Using Intrascene Feature Similarity and Interscene Semantic Dependency , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Gang Xu,et al.  Proximity Expansion Index: An improved approach to characterize evolution process of urban expansion , 2018, Comput. Environ. Urban Syst..

[28]  Zhang Bo,et al.  Analysis Vegetation Cover Change in Functional Zones based on Remote Sensing——A Multitemporal Study in Malian River Watershed of Loess Plateau , 2013 .

[29]  R. O'Neill,et al.  Lacunarity indices as measures of landscape texture , 1993, Landscape Ecology.

[30]  S. Arlinghaus,et al.  The Fractal Theory of Central Place Geometry: A Diophantine Analysis of Fractal Generators for Arbitrary Löschian Numbers , 2010 .

[31]  Michael Meinild Nielsen,et al.  Remote sensing for urban planning and management: The use of window-independent context segmentation to extract urban features in Stockholm , 2015, Comput. Environ. Urban Syst..

[32]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[33]  Xin Pan,et al.  A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[34]  Yin Pan,et al.  Cloud Detection in Remote Sensing Images Based on Multiscale Features-Convolutional Neural Network , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Brian Johnson,et al.  Classifying a high resolution image of an urban area using super-object information , 2013 .

[36]  Min Wang,et al.  Very high resolution remote sensing image classification with SEEDS-CNN and scale effect analysis for superpixel CNN classification , 2018, International Journal of Remote Sensing.

[37]  Min Wang,et al.  Stratified Object-Oriented Image Classification Based on Remote Sensing Image Scene Division , 2018, Journal of Spectroscopy.

[38]  T. Esch,et al.  Urban structure type characterization using hyperspectral remote sensing and height information , 2012 .

[39]  Luo Jiancheng,et al.  Information extraction from high resolution remote sensing image and parcel unit extraction based on features , 2005 .

[40]  Xiaoping Liu,et al.  Sensing spatial distribution of urban land use by integrating points-of-interest and Google Word2Vec model , 2017, Int. J. Geogr. Inf. Sci..

[41]  D. Joly,et al.  Urban-rural-natural gradient analysis with CORINE data: An application to the metropolitan France , 2018 .

[42]  Yen-Chu Weng Spatiotemporal changes of landscape pattern in response to urbanization , 2007 .

[43]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[44]  Xuehua Liu,et al.  Scientific solutions for the functional zoning of nature reserves in China , 2008 .

[45]  Hyun Bang Shin,et al.  Residential Redevelopment and the Entrepreneurial Local State: The Implications of Beijing’s Shifting Emphasis on Urban Redevelopment Policies , 2009 .

[46]  Z. Pengjun,et al.  Transportation implications of the metropolitan spatial planning in megacity Beijing , 2009 .

[47]  Yuanman Hu,et al.  Effects of urbanization on direct runoff characteristics in urban functional zones. , 2018, The Science of the total environment.

[48]  L. Jiao Urban land density function: A new method to characterize urban expansion , 2015 .

[49]  Yang Yu,et al.  Exploring Urban Spatial Feature with Dasymetric Mapping Based on Mobile Phone Data and LUR-2SFCAe Method , 2018, Sustainability.

[50]  Min Wang,et al.  A New Method for Region-Based Majority Voting CNNs for Very High Resolution Image Classification , 2018, Remote. Sens..

[51]  X. Yu,et al.  Spatial and temporal dynamics of urban sprawl along two urban–rural transects: A case study of Guangzhou, China , 2007 .

[52]  M. Batty The Size, Scale, and Shape of Cities , 2008, Science.

[53]  S. Pickett,et al.  Spatial heterogeneity in urban ecosystems: reconceptualizing land cover and a framework for classification , 2007 .

[54]  Bo Huang,et al.  Using multi-source geospatial big data to identify the structure of polycentric cities , 2017 .