Open-source data-driven urban land-use mapping integrating point-line-polygon semantic objects: A case study of Chinese cities

Abstract Reliable urban land-use maps are essential for urban analysis because the spatial distribution of land use reflects the complex environment of cities under the combined effects of nature and socio-economics. In recent years, very high resolution (VHR) remote sensing imagery interpretation has resolved the “semantic gap” between the low-level data and the high-level semantic scenes, and has been used to map urban land use. Nevertheless, the existing frameworks cannot easily be applied to practical urban analysis, which can be attributed to three main reasons: 1) the indistinguishable socio-economic attributes of the same ground object layouts; 2) the weak transferability of the supervised frameworks and the time-consuming training sample annotation; and 3) the category system inconsistency between the data source and the urban land-use application. In this paper, to achieve an “application gap” breakthrough for urban land-use mapping, a data-driven point, line, and polygon semantic object mapping (PLPSOM) framework is proposed, which makes full use of open-source VHR images and multi-source geospatial data. In the PLPSOM framework, point, line, and polygon semantic objects are represented by the points of interest (POIs), OpenStreetMap (OSM) data, and VHR images corresponding to the scenes in the land-use mapping units, respectively. OSM line semantic objects are utilized to supply the boundaries of the land-use mapping units for the POIs and VHR images, forming urban land parcels (street blocks). To reduce the cost of the data annotation, the training dataset is constructed using multiple open-source data sources. An enhanced deep adaptation network (EDAN) is then proposed to acquire the categories of the VHR scene images in the case of partial transfer learning. Finally, in order to meet the actual needs, a rule-based category mapping (RCM) model is applied to integrate the categories of the POIs and VHR images into the urban land-use category system, allowing us to acquire the land-use maps of the cities. The effectiveness of the proposed method was tested in four cities of China, including six specific areas: Beijing and Wuhan city centers; the Hanyang District of Wuhan; the Hannan District of Wuhan; Macao; and the Wan Chai area of Hong Kong, achieving a high classification accuracy. The “urban image” analysis confirmed the practicality of the obtained urban land-use maps.

[1]  David Masko,et al.  The Impact of Imbalanced Training Data for Convolutional Neural Networks , 2015 .

[2]  Peng Gong,et al.  Mapping Urban Land Use by Using Landsat Images and Open Social Data , 2016, Remote. Sens..

[3]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[4]  Jefersson Alex dos Santos,et al.  Evaluating the Potential of Texture and Color Descriptors for Remote Sensing Image Retrieval and Classification , 2010, VISAPP.

[5]  K. Lynch,et al.  Reconsidering The Image of the City , 1984 .

[6]  M. Herold,et al.  Spatial Metrics and Image Texture for Mapping Urban Land Use , 2003 .

[7]  Jefersson Alex dos Santos,et al.  Towards better exploiting convolutional neural networks for remote sensing scene classification , 2016, Pattern Recognit..

[8]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[9]  Fan Zhang,et al.  A multi-task convolutional neural network for mega-city analysis using very high resolution satellite imagery and geospatial data , 2017, ArXiv.

[10]  Bertrand Le Saux,et al.  Joint Learning from Earth Observation and OpenStreetMap Data to Get Faster Better Semantic Maps , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[11]  Tao Lin,et al.  Mapping Urban Functional Zones by Integrating Very High Spatial Resolution Remote Sensing Imagery and Points of Interest: A Case Study of Xiamen, China , 2018, Remote. Sens..

[12]  Makoto Kawamura,et al.  COMPARISON OF URBANIZATION OF FOUR ASIAN CITIES USING SATELLITE DATA , 1998 .

[13]  Xin Pan,et al.  An object-based convolutional neural network (OCNN) for urban land use classification , 2018, Remote Sensing of Environment.

[14]  Alexander Zipf,et al.  Toward mapping land-use patterns from volunteered geographic information , 2013, Int. J. Geogr. Inf. Sci..

[15]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Xinyu Wang,et al.  Blind Hyperspectral Unmixing Considering the Adjacency Effect , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[18]  Liangpei Zhang,et al.  The Fisher Kernel Coding Framework for High Spatial Resolution Scene Classification , 2016, Remote. Sens..

[19]  Filipe Rodrigues,et al.  Automatic Classification of Points-of-Interest for Land-use Analysis , 2012 .

[20]  Courage Kamusoko,et al.  Importance of Remote Sensing and Land Change Modeling for Urbanization Studies , 2017 .

[21]  Yao Yao,et al.  Sensing Urban Land-Use Patterns By Integrating Google Tensorflow And Scene-Classification Models , 2017, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[22]  Jiebo Luo,et al.  Improved scene classification using efficient low-level features and semantic cues , 2004, Pattern Recognit..

[23]  Xiaoping Liu,et al.  Sensing spatial distribution of urban land use by integrating points-of-interest and Google Word2Vec model , 2017, Int. J. Geogr. Inf. Sci..

[24]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[25]  Bei Zhao,et al.  Scene Semantic Understanding Based on the Spatial Context Relations of Multiple Objects , 2017, Remote. Sens..

[26]  Liangpei Zhang,et al.  Scene Classification Based on the Fully Sparse Semantic Topic Model , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  A. Dewan,et al.  Land use and land cover change in Greater Dhaka, Bangladesh: Using remote sensing to promote sustainable urbanization , 2009 .

[28]  Sabine Vanhuysse,et al.  Mapping Urban Land Use at Street Block Level Using OpenStreetMap, Remote Sensing Data, and Spatial Metrics , 2018, ISPRS Int. J. Geo Inf..

[29]  Xiaoping Liu,et al.  Classifying urban land use by integrating remote sensing and social media data , 2017, Int. J. Geogr. Inf. Sci..

[30]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[31]  Xingjian Liu,et al.  Automated identification and characterization of parcels (AICP) with OpenStreetMap and Points of Interest , 2013, ArXiv.

[32]  Chao Zhang,et al.  Land use classification in construction areas based on volunteered geographic information , 2016, 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics).

[33]  A. Soliman,et al.  Social sensing of urban land use based on analysis of Twitter users’ mobility patterns , 2017, PloS one.

[34]  Bo Huang,et al.  Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery , 2018, Remote Sensing of Environment.

[35]  Liangpei Zhang,et al.  Scene Classification Based on the Sparse Homogeneous–Heterogeneous Topic Feature Model , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[36]  E. Lynn Usery,et al.  A Spatial Data Model Design for Feature-Based Geographical Information Systems , 1996, Int. J. Geogr. Inf. Sci..

[37]  Marco Minghini,et al.  Generating Up-to-Date and Detailed Land Use and Land Cover Maps Using OpenStreetMap and GlobeLand30 , 2017, ISPRS Int. J. Geo Inf..

[38]  Bei Zhao,et al.  Scene classification via latent Dirichlet allocation using a hybrid generative/discriminative strategy for high spatial resolution remote sensing imagery , 2013 .

[39]  Qingming Zhan,et al.  Urban land use extraction from Very High Resolution remote sensing imagery using a Bayesian network , 2016 .

[40]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Wei Tu,et al.  Portraying Urban Functional Zones by Coupling Remote Sensing Imagery and Human Sensing Data , 2018, Remote. Sens..

[42]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[43]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.