Feature Importance Analysis for Local Climate Zone Classification Using a Residual Convolutional Neural Network with Multi-Source Datasets

Global Local Climate Zone (LCZ) maps, indicating urban structures and land use, are crucial for Urban Heat Island (UHI) studies and also as starting points to better understand the spatio-temporal dynamics of cities worldwide. However, reliable LCZ maps are not available on a global scale, hindering scientific progress across a range of disciplines that study the functionality of sustainable cities. As a first step towards large-scale LCZ mapping, this paper tries to provide guidance about data/feature choice. To this end, we evaluate the spectral reflectance and spectral indices of the globally available Sentinel-2 and Landsat-8 imagery, as well as the Global Urban Footprint (GUF) dataset, the OpenStreetMap layers buildings and land use and the Visible Infrared Imager Radiometer Suite (VIIRS)-based Nighttime Light (NTL) data, regarding their relevance for discriminating different Local Climate Zones (LCZs). Using a Residual convolutional neural Network (ResNet), a systematic analysis of feature importance is performed with a manually-labeled dataset containing nine cities located in Europe. Based on the investigation of the data and feature choice, we propose a framework to fully exploit the available datasets. The results show that GUF, OSM and NTL can contribute to the classification accuracy of some LCZs with relatively few samples, and it is suggested that Landsat-8 and Sentinel-2 spectral reflectances should be jointly used, for example in a majority voting manner, as proven by the improvement from the proposed framework, for large-scale LCZ mapping.

[1]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[2]  Jay Gao,et al.  Use of normalized difference built-up index in automatically mapping urban areas from TM imagery , 2003 .

[3]  T. Esch,et al.  Monitoring urbanization in mega cities from space , 2012 .

[4]  Hannes Taubenböck,et al.  TanDEM-X mission—new perspectives for the inventory and monitoring of global settlement patterns , 2012 .

[5]  T. Oke,et al.  Local Climate Zones for Urban Temperature Studies , 2012 .

[6]  Thomas Esch,et al.  Urban Footprint Processor—Fully Automated Processing Chain Generating Settlement Masks From Global Data of the TanDEM-X Mission , 2013, IEEE Geoscience and Remote Sensing Letters.

[7]  Timothy R. Oke,et al.  Evaluation of the ‘local climate zone’ scheme using temperature observations and model simulations , 2014 .

[8]  Jianping Wu,et al.  Evaluating the Ability of NPP-VIIRS Nighttime Light Data to Estimate the Gross Domestic Product and the Electric Power Consumption of China at Multiple Scales: A Comparison with DMSP-OLS Data , 2014, Remote. Sens..

[9]  Jianping Wu,et al.  Estimating House Vacancy Rate in Metropolitan Areas Using NPP-VIIRS Nighttime Light Composite Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[10]  P. Gong,et al.  Target Detection Method for Water Mapping Using Landsat 8 OLI/TIRS Imagery , 2015 .

[11]  Iain Stewart,et al.  Mapping Local Climate Zones for a Worldwide Database of the Form and Function of Cities , 2015, ISPRS Int. J. Geo Inf..

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Hannes Taubenböck,et al.  How good is the map? A multi-scale cross-comparison framework for global settlement layers: Evidence from Central Europe , 2016 .

[14]  Ryutaro Tateishi,et al.  Global mapping of urban built-up areas of year 2014 by combining MODIS multispectral data with VIIRS nighttime light data , 2016, Int. J. Digit. Earth.

[15]  Julien Radoux,et al.  Sentinel-2's Potential for Sub-Pixel Landscape Feature Detection , 2016, Remote. Sens..

[16]  Un Desa Transforming our world : The 2030 Agenda for Sustainable Development , 2016 .

[17]  Frieke Van Coillie,et al.  Quality of Crowdsourced Data on Urban Morphology—The Human Influence Experiment (HUMINEX) , 2017 .

[18]  Michael Dixon,et al.  Google Earth Engine: Planetary-scale geospatial analysis for everyone , 2017 .

[19]  Naoto Yokoya,et al.  Multimodal, multitemporal, and multisource global data fusion for local climate zones classification based on ensemble learning , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[20]  Linda See,et al.  Using the LCZ framework for change detection and urban growthmonitoring , 2017 .

[21]  Steven Jige Quan,et al.  Local Climate Zone Mapping for Energy Resilience: A Fine-grained and 3D Approach ☆ , 2017 .

[22]  Yee Leung,et al.  A co-training approach to the classification of local climate zones with multi-source data , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[23]  Eberhard Parlow,et al.  Attribution of local climate zones using a multitemporal land use/land cover classification scheme , 2017 .

[24]  C. Elvidge,et al.  VIIRS night-time lights , 2017, Remote Sensing of Night-time Light.

[25]  Edward Ng,et al.  Spatial Variability of Geriatric Depression Risk in a High ‐ Density City : A Data ‐ Driven Socio ‐ Environmental Vulnerability Mapping , 2022 .

[26]  Dieter Scherer,et al.  Intra and inter ‘local climate zone’ variability of air temperature as observed by crowdsourced citizen weather stations in Berlin, Germany , 2017 .

[27]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[28]  Naoto Yokoya,et al.  Open Data for Global Multimodal Land Use Classification: Outcome of the 2017 IEEE GRSS Data Fusion Contest , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[29]  Soe W. Myint,et al.  Assessing local climate zones in arid cities: The case of Phoenix, Arizona and Las Vegas, Nevada , 2018, ISPRS Journal of Photogrammetry and Remote Sensing.

[30]  Rajashree Kotharkar,et al.  Evaluating urban heat island in the critical local climate zones of an Indian city , 2018 .

[31]  Qi Wang,et al.  Optimal Clustering Framework for Hyperspectral Band Selection , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Xiao Xiang Zhu,et al.  EFFECT OF THE TRAINING SET CONFIGURATION ON SENTINEL-2-BASED URBAN LOCAL CLIMATE ZONE CLASSIFICATION , 2018, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[33]  Daniel Fenner,et al.  Micro-Scale Variability of Air Temperature within a Local Climate Zone in Berlin, Germany, during Summer , 2018 .

[34]  Xuelong Li,et al.  Locality and Structure Regularized Low Rank Representation for Hyperspectral Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Xiao Xiang Zhu,et al.  Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Xuelong Li,et al.  Scene Classification With Recurrent Attention of VHR Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.