Integrating remote sensing and geospatial big data for urban land use mapping: A review

Remote Sensing (RS) has been used in urban mapping for a long time; however, the complexity and diversity of urban functional patterns are difficult to be captured by RS only. Emerging Geospatial Big Data (GBD) are considered as the supplement to RS data, and help to contribute to our understanding of urban lands from physical aspects (i.e., urban land cover) to socioeconomic aspects (i.e., urban land use). Integrating RS and GBD could be an effective way to combine physical and socioeconomic aspects with great potential for high-quality urban land use classification. In this study, we reviewed the existing literature and focused on the state-of-the-art and perspective of the urban land use categorization by integrating RS and GBD. Specifically, the commonly used RS features (e.g., spectral, textural, temporal, and spatial features) and GBD features (e.g., spatial, temporal, semantic, and sequence features) were identified and analyzed in urban land use classification. The integration strategies for RS and GBD features were categorized into feature-level integration (FI) and decision-level integration (DI). To be more specific, the FI method integrates the RS and GBD features and classifies urban land use types using the integrated feature sets; the DI method processes RS and GBD independently and then merges the classification results based on decision rules. We also discussed other critical issues, including analysis unit setting, parcel segmentation, parcel labeling of land use types, and data integration. Our findings provide a retrospect of different features from RS and GBD, strategies of RS and GBD integration, and their pros and cons, which could help to define the framework for future urban land use mapping and better support urban planning, urban environment assessment, urban disaster monitoring and urban traffic analysis.

[1]  Philip J. Howarth,et al.  Landsat digital enhancements for change detection in urban environments , 1983 .

[2]  Xiao Xiang Zhu,et al.  Classification of Settlement Types from Tweets Using LDA and LSTM , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[3]  R. Kitchin,et al.  Big data and human geography , 2013 .

[4]  Xiaolu Zhou,et al.  Crowdsourcing functions of the living city from Twitter and Foursquare data , 2016 .

[5]  Hannes Taubenböck,et al.  TanDEM-X mission—new perspectives for the inventory and monitoring of global settlement patterns , 2012 .

[6]  Jianya Gong,et al.  GeoComputation for Geospatial Big Data , 2014 .

[7]  Zongming Wang,et al.  Mapping the Essential Urban Land Use in Changchun by Applying Random Forest and Multi-Source Geospatial Data , 2020, Remote. Sens..

[8]  Qijun Jiang,et al.  Citizen Sensing for Improved Urban Environmental Monitoring , 2016, J. Sensors.

[9]  Hannes Taubenböck,et al.  Slum mapping in polarimetric SAR data using spatial features , 2017 .

[10]  Peng Gong,et al.  Mapping Essential Urban Land Use Categories in Beijing with a Fast Area of Interest (AOI)-Based Method , 2021, Remote. Sens..

[11]  Zhe Zhu,et al.  Understanding an urbanizing planet: Strategic directions for remote sensing , 2019, Remote Sensing of Environment.

[12]  Juan Li,et al.  Live-Work-Play Centers of Chinese cities: Identification and temporal evolution with emerging data , 2018, Comput. Environ. Urban Syst..

[13]  Chaogui Kang,et al.  Social Sensing: A New Approach to Understanding Our Socioeconomic Environments , 2015 .

[14]  Tao Lin,et al.  Mapping Urban Functional Zones by Integrating Very High Spatial Resolution Remote Sensing Imagery and Points of Interest: A Case Study of Xiamen, China , 2018, Remote. Sens..

[15]  Pengbo Liu,et al.  A Methodology to Monitor Urban Expansion and Green Space Change Using a Time Series of Multi-Sensor SPOT and Sentinel-2A Images , 2019, Remote. Sens..

[16]  Bin Chen,et al.  Stable classification with limited sample: transferring a 30-m resolution sample set collected in 2015 to mapping 10-m resolution global land cover in 2017. , 2019, Science bulletin.

[17]  Huadong Guo,et al.  A Global Human Settlement Layer From Optical HR/VHR RS Data: Concept and First Results , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[18]  Dongping Ming,et al.  DFCNN-Based Semantic Recognition of Urban Functional Zones by Integrating Remote Sensing Data and POI Data , 2020, Remote. Sens..

[19]  Christelle Vancutsem,et al.  GlobCover: ESA service for global land cover from MERIS , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[20]  R. Zurita-Milla,et al.  Exploring Spatiotemporal Phenological Patterns and Trajectories Using Self-Organizing Maps , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Michael F. Goodchild,et al.  Please Scroll down for Article International Journal of Digital Earth Crowdsourcing Geographic Information for Disaster Response: a Research Frontier Crowdsourcing Geographic Information for Disaster Response: a Research Frontier , 2022 .

[22]  Jianghao Wang,et al.  Urban Land Use Mapping by Combining Remote Sensing Imagery and Mobile Phone Positioning Data , 2018, Remote. Sens..

[23]  Xiao Xiang Zhu,et al.  Building Instance Classification Using Street View Images , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[24]  Alan H. Strahler,et al.  Global land cover mapping from MODIS: algorithms and early results , 2002 .

[25]  Giorgos Mountrakis,et al.  Assessing integration of intensity, polarimetric scattering, interferometric coherence and spatial texture metrics in PALSAR-derived land cover classification , 2014 .

[26]  Q. Han,et al.  The multi-objective spatial optimization of urban land use based on low-carbon city planning , 2021 .

[27]  Philip J. Howarth,et al.  Performance analyses of probabilistic relaxation methods for land-cover classification☆ , 1989 .

[28]  Fahui Wang,et al.  Urban land uses and traffic 'source-sink areas': Evidence from GPS-enabled taxi data in Shanghai , 2012 .

[29]  M. A. Brovelli,et al.  From paper maps to the Digital Earth and the Internet of Places , 2015, Rendiconti Lincei.

[30]  F. Meier,et al.  Hyperlocal mapping of urban air temperature using remote sensing and crowdsourced weather data , 2020 .

[31]  N. Hamm,et al.  Unbalanced Development Characteristics and Driving Mechanisms of Regional Urban Spatial Form: A Case Study of Jiangsu Province, China , 2021, Sustainability.

[32]  Satish V. Ukkusuri,et al.  Inferring Urban Land Use Using Large-Scale Social Media Check-in Data , 2014 .

[33]  Hanfa Xing,et al.  Integrating landscape metrics and socioeconomic features for urban functional region classification , 2018, Comput. Environ. Urban Syst..

[34]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[35]  William J. Emery,et al.  A neural network approach using multi-scale textural metrics from very high-resolution panchromatic imagery for urban land-use classification , 2009 .

[36]  Hermann Kaufmann,et al.  Determination of robust spectral features for identification of urban surface materials in hyperspectral remote sensing data , 2007 .

[37]  J. Scheffran,et al.  Impacts of changing urban land-use structure on sustainable city growth in China: A population-density dynamics perspective , 2021 .

[38]  Qunying Huang,et al.  Using Twitter for tasking remote-sensing data collection and damage assessment: 2013 Boulder flood case study , 2016 .

[39]  G. Cao,et al.  Tweets or nighttime lights: Comparison for preeminence in estimating socioeconomic factors , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[40]  Juan Carlos Duque,et al.  A review of regional science applications of satellite remote sensing in urban settings , 2013, Comput. Environ. Urban Syst..

[41]  D. Roberts,et al.  Generalizing machine learning regression models using multi-site spectral libraries for mapping vegetation-impervious-soil fractions across multiple cities , 2018, Remote Sensing of Environment.

[42]  Qingquan Li,et al.  Functional urban land use recognition integrating multi-source geospatial data and cross-correlations , 2019, Comput. Environ. Urban Syst..

[43]  Dirk Pflugmacher,et al.  Mapping pan-European land cover using Landsat spectral-temporal metrics and the European LUCAS survey , 2019, Remote Sensing of Environment.

[44]  William J. Emery,et al.  Exploring semantic elements for urban scene recognition: Deep integration of high-resolution imagery and OpenStreetMap (OSM) , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[45]  Christopher M. Danforth,et al.  The Geography of Happiness: Connecting Twitter Sentiment and Expression, Demographics, and Objective Characteristics of Place , 2013, PloS one.

[46]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[47]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[48]  R. Nemani,et al.  Global Distribution and Density of Constructed Impervious Surfaces , 2007, Sensors.

[49]  Jie Li,et al.  Rethinking big data: A review on the data quality and usage issues , 2016 .

[50]  Chao Wang,et al.  Annual large-scale urban land mapping based on Landsat time series in Google Earth Engine and OpenStreetMap data: A case study in the middle Yangtze River basin , 2020 .

[51]  Vanessa Frías-Martínez,et al.  Spectral clustering for sensing urban land use using Twitter activity , 2014, Engineering applications of artificial intelligence.

[52]  Shihong Du,et al.  Hierarchical semantic cognition for urban functional zones with VHR satellite images and POI data , 2017 .

[53]  Yu Liu,et al.  An Ensemble Learning Approach for Urban Land Use Mapping Based on Remote Sensing Imagery and Social Sensing Data , 2020, Remote. Sens..

[54]  D. Lu,et al.  Use of impervious surface in urban land-use classification , 2006 .

[55]  Jin Chen,et al.  Global land cover mapping at 30 m resolution: A POK-based operational approach , 2015 .

[56]  Sheng Wei,et al.  Remote Sensing and Social Sensing Data Reveal Scale-Dependent and System-Specific Strengths of Urban Heat Island Determinants , 2020, Remote. Sens..

[57]  Bin Jiang,et al.  Geospatial Big Data Handling Theory and Methods: A Review and Research Challenges , 2015, ArXiv.

[58]  C. Woodcock,et al.  Assessment of spectral, polarimetric, temporal, and spatial dimensions for urban and peri-urban land cover classification using Landsat and SAR data , 2012 .

[59]  Qunying Huang,et al.  Introduction to social sensing and big data computing for disaster management , 2019, Int. J. Digit. Earth.

[60]  Yi Xu,et al.  Exploring Impact of Spatial Unit on Urban Land Use Mapping with Multisource Data , 2020, Remote. Sens..

[61]  Bo Huang,et al.  Using multi-source geospatial big data to identify the structure of polycentric cities , 2017 .

[62]  Jon Atli Benediktsson,et al.  Spatial technology and social media in remote sensing: challenges and opportunities [point of view] , 2017, Proc. IEEE.

[63]  Hongyang Lu,et al.  Classification of High-Resolution Remote-Sensing Image Using OpenStreetMap Information , 2017, IEEE Geoscience and Remote Sensing Letters.

[64]  P. Jarreau,et al.  Social media for social change in science , 2018, Science.

[65]  Xuan Zhu,et al.  Automatic land cover classification of geo-tagged field photos by deep learning , 2017, Environ. Model. Softw..

[66]  Sneha A. Dalvi,et al.  Internet of Things for Smart Cities , 2017 .

[67]  Jianping Wu,et al.  Integration of nighttime light remote sensing images and taxi GPS tracking data for population surface enhancement , 2018, Int. J. Geogr. Inf. Sci..

[68]  Yuqi Bai,et al.  Mapping essential urban land use categories in China (EULUC-China): preliminary results for 2018. , 2020, Science bulletin.

[69]  Xiaoping Liu,et al.  High-resolution multi-temporal mapping of global urban land using Landsat images based on the Google Earth Engine Platform , 2018 .

[70]  Monika Kuffer,et al.  Slums from Space - 15 Years of Slum Mapping Using Remote Sensing , 2016, Remote. Sens..

[71]  Xuan Liu,et al.  Classification of High Resolution Urban Remote Sensing Images Using Deep Networks by Integration of Social Media Photos , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[72]  R. Ilieva,et al.  Social-media data for urban sustainability , 2018, Nature Sustainability.

[73]  Qunying Huang,et al.  Integrating big social data, computing and modeling for spatial social science , 2016 .

[74]  Yuyu Zhou,et al.  A national dataset of 30-m annual urban extent dynamics (1985–2015) in the conterminous United States , 2019 .

[75]  Frančula Nedjeljko,et al.  Volunteered Geographic Information , 2014, Encyclopedia of Social Network Analysis and Mining.

[76]  Krzysztof Janowicz,et al.  Extracting and understanding urban areas of interest using geotagged photos , 2015, Comput. Environ. Urban Syst..

[77]  J. Townshend,et al.  Global land cover classi(cid:142) cation at 1 km spatial resolution using a classi(cid:142) cation tree approach , 2004 .

[78]  Chenghu Zhou,et al.  A new insight into land use classification based on aggregated mobile phone data , 2013, Int. J. Geogr. Inf. Sci..

[79]  Mohd Talib Latif,et al.  Spatial assessment of land use impact on air quality in mega urban regions, Malaysia , 2020 .

[80]  Peng Gong,et al.  Mapping Urban Land Use by Using Landsat Images and Open Social Data , 2016, Remote. Sens..

[81]  Jinwei Dong,et al.  Decision-Level and Feature-Level Integration of Remote Sensing and Geospatial Big Data for Urban Land Use Mapping , 2021, Remote. Sens..

[82]  Jun Li,et al.  Social Media: New Perspectives to Improve Remote Sensing for Emergency Response , 2017, Proceedings of the IEEE.

[83]  Wei Tu,et al.  Portraying Urban Functional Zones by Coupling Remote Sensing Imagery and Human Sensing Data , 2018, Remote. Sens..

[84]  Joachim Denzler,et al.  Deep learning and process understanding for data-driven Earth system science , 2019, Nature.

[85]  Weijia Li,et al.  Integrating Google Earth imagery with Landsat data to improve 30-m resolution land cover mapping , 2020 .

[86]  Pablo Martí,et al.  Social Media data: Challenges, opportunities and limitations in urban studies , 2019, Comput. Environ. Urban Syst..

[87]  Xin Huang,et al.  An updated MODIS global urban extent product (MGUP) from 2001 to 2018 based on an automated mapping approach , 2021, Int. J. Appl. Earth Obs. Geoinformation.

[88]  Ying Long,et al.  Understanding uneven urban expansion with natural cities using open data , 2017, Landscape and Urban Planning.

[89]  Xuefei Hu,et al.  Estimating impervious surfaces using linear spectral mixture analysis with multitemporal ASTER images , 2009 .

[90]  A. Belward,et al.  GLC2000: a new approach to global land cover mapping from Earth observation data , 2005 .

[91]  A. Zipf,et al.  Comparative Spatial Analysis of Positional Accuracy of OpenStreetMap and Proprietary Geodata , 2012 .

[92]  Xiaoping Liu,et al.  Classifying urban land use by integrating remote sensing and social media data , 2017, Int. J. Geogr. Inf. Sci..

[93]  Hone-Jay Chu,et al.  Social Sensing for Urban Land Use Identification , 2020, ISPRS Int. J. Geo Inf..

[94]  Xiaoping Liu,et al.  Delineating urban functional areas with building-level social media data: A dynamic time warping (DTW) distance based k-medoids method , 2017 .

[95]  Rozenn Dahyot,et al.  Automatic Discovery and Geotagging of Objects from Street View Imagery , 2017, Remote. Sens..

[96]  Zoe Falomir,et al.  Rule-guided human classification of Volunteered Geographic Information , 2017 .

[97]  Qunying Huang,et al.  An integrative method for mapping urban land use change using "geo-sensor" data , 2015, UrbanGIS@SIGSPATIAL.

[98]  Sensen Wu,et al.  A GloVe-Based POI Type Embedding Model for Extracting and Identifying Urban Functional Regions , 2021, ISPRS Int. J. Geo Inf..

[99]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[100]  B. Xu,et al.  A novel method to extract urban human settlements by integrating remote sensing and mobile phone locations , 2020 .

[101]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[102]  Erle C. Ellis,et al.  Putting people in the map: anthropogenic biomes of the world , 2008 .

[103]  M. Masoudi,et al.  The effects of land use on spatial pattern of urban green spaces and their cooling ability , 2021 .

[104]  Matthew E. Kahn,et al.  Air pollution lowers Chinese urbanites’ expressed happiness on social media , 2019, Nature Human Behaviour.

[105]  Devis Tuia,et al.  Fine-grained landuse characterization using ground-based pictures: a deep learning solution based on globally available data , 2018, Int. J. Geogr. Inf. Sci..

[106]  Jing Sun,et al.  Mapping Essential Urban Land Use Categories in Nanjing by Integrating Multi-Source Big Data , 2020, Remote. Sens..

[107]  Hao Li,et al.  Mapping Dynamic Urban Land Use Patterns with Crowdsourced Geo-Tagged Social Media (Sina-Weibo) and Commercial Points of Interest Collections in Beijing, China , 2016 .

[108]  Lun Wu,et al.  Social sensing from street-level imagery: A case study in learning spatio-temporal urban mobility patterns , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[109]  Xin Du,et al.  The Combined Use of Remote Sensing and Social Sensing Data in Fine-Grained Urban Land Use Mapping: A Case Study in Beijing, China , 2017, Remote. Sens..

[110]  Ying Wang,et al.  Urban Observation: Integration of Remote Sensing and Social Media Data , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[111]  B. Johnson,et al.  Integrating OpenStreetMap crowdsourced data and Landsat time-series imagery for rapid land use/land cover (LULC) mapping: Case study of the Laguna de Bay area of the Philippines , 2016 .

[112]  Shihong Du,et al.  Heuristic sample learning for complex urban scenes: Application to urban functional-zone mapping with VHR images and POI data , 2020 .

[113]  Simona R. Grădinaru,et al.  Urban land-use change: The role of strategic spatial planning , 2018, Global Environmental Change.

[114]  Hankui K. Zhang,et al.  Finer resolution observation and monitoring of global land cover: first mapping results with Landsat TM and ETM+ data , 2013 .

[115]  Ji Zhao,et al.  Open-source data-driven urban land-use mapping integrating point-line-polygon semantic objects: A case study of Chinese cities , 2020 .

[116]  Yao Yao,et al.  Mapping fine‐scale urban housing prices by fusing remotely sensed imagery and social media data , 2018, Trans. GIS.

[117]  Yu Liu,et al.  A framework for mixed-use decomposition based on temporal activity signatures extracted from big geo-data , 2018, Int. J. Digit. Earth.

[118]  S. Du,et al.  Large-scale urban functional zone mapping by integrating remote sensing images and open social data , 2020 .

[119]  A. Plaza,et al.  Urban Impervious Surface Estimation from Remote Sensing and Social Data , 2018, Photogrammetric Engineering & Remote Sensing.

[120]  Lan Mu,et al.  GIS analysis of depression among Twitter users , 2015 .

[121]  Zhaohui Wu,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS 1 Land-Use Classification Using Taxi GPS Traces , 2022 .

[122]  Fang Wu,et al.  Recognizing urban functional zones by a hierarchical fusion method considering landscape features and human activities , 2020, Trans. GIS.

[123]  Yuyu Zhou,et al.  A global record of annual urban dynamics (1992–2013) from nighttime lights , 2018, Remote Sensing of Environment.

[124]  Wei Zhang,et al.  40-Year (1978-2017) human settlement changes in China reflected by impervious surfaces from satellite remote sensing. , 2019, Science bulletin.

[125]  Ying Long,et al.  How green are the streets? An analysis for central areas of Chinese cities using Tencent Street View , 2017, PloS one.

[126]  M. Friedl,et al.  Mapping global urban areas using MODIS 500-m data: new methods and datasets based on 'urban ecoregions'. , 2010 .

[127]  Martin Herold,et al.  Spectral resolution requirements for mapping urban areas , 2003, IEEE Trans. Geosci. Remote. Sens..

[128]  Yuan Zhang,et al.  Social functional mapping of urban green space using remote sensing and social sensing data , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[129]  Jinwei Dong,et al.  Evolution of regional to global paddy rice mapping methods: A review , 2016 .

[130]  Xia Li,et al.  The Traj2Vec model to quantify residents’ spatial trajectories and estimate the proportions of urban land-use types , 2020, Int. J. Geogr. Inf. Sci..

[131]  Jinchao Song,et al.  Spatio-temporal patterns of traffic-related air pollutant emissions in different urban functional zones estimated by real-time video and deep learning technique , 2019, Journal of Cleaner Production.

[132]  Limin Yang,et al.  Development of a global land cover characteristics database and IGBP DISCover from 1 km AVHRR data , 2000 .

[133]  Mei Liu,et al.  A New Remote Sensing Images and Point-of-Interest Fused (RPF) Model for Sensing Urban Functional Regions , 2020, Remote. Sens..

[134]  Karen C. Seto,et al.  A systematic review and assessment of algorithms to detect, characterize, and monitor urban land change , 2020 .

[135]  N. Frantzeskaki,et al.  Sustainability and resilience for transformation in the urban century , 2019, Nature Sustainability.

[136]  Yu Liu,et al.  Inferring trip purposes and uncovering travel patterns from taxi trajectory data , 2016 .

[137]  Chuanrong Li,et al.  Classification of High Resolution Remote Sensing Images Based on PCA, HSV and Texture Feature , 2018 .

[138]  P. Crutzen,et al.  The Anthropocene: conceptual and historical perspectives , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[139]  Hui Zhang,et al.  Urban Land Use and Land Cover Classification Using Multisource Remote Sensing Images and Social Media Data , 2019, Remote. Sens..

[140]  Jiasong Zhu,et al.  Deep learning-based remote and social sensing data fusion for urban region function recognition , 2020 .

[141]  Rob Kitchin,et al.  What makes Big Data, Big Data? Exploring the ontological characteristics of 26 datasets , 2016, Big Data Soc..

[142]  K. Seto,et al.  A Meta-Analysis of Global Urban Land Expansion , 2011, PloS one.

[143]  Qunying Huang,et al.  A cloud-enabled automatic disaster analysis system of multi-sourced data streams: An example synthesizing social media, remote sensing and Wikipedia data , 2017, Comput. Environ. Urban Syst..