SAR4LCZ-Net: A Complex-valued Convolutional Neural Network for Local Climate Zones Classification Using Gaofen-3 Quad-pol SAR Data

The recent local climate zones (LCZ) classification scheme provides spatially fine granular descriptions of inner-urban morphology. It is universally applicable to cities worldwide and capable of supporting various urban studies. Although optical and dual-pol SAR data continue to push the frontiers of this task, the potential of quad-pol SAR data for LCZ classification is not yet explored. In this paper we propose a novel complex-valued convolutional neural network (CNN), SAR4LCZ-Net, to tackle this challenge. SAR4LCZ-Net improves the state of the art by exploiting two facts of this specific task: the semantic hierarchical structure of the LCZ classification scheme, and the complex-valued nature of quad-pol SAR data. To validate the performance of our algorithm, we generate a Chinese Gaofen-3 quad-pol SAR data set for LCZ which covers 31 cities around the world. Results show that the proposed SAR4LCZ-Net improves 2.4% on overall accuracy and 4.5% on average accuracy compared to the real-valued CNN with same structure. Gaofen-3 quad-pol SAR data also showed its advantage over the dual-pol Sentinel-1 data. It enhanced 5.0% on overall accuracy and 7.2% on average accuracy in LCZ classification, under a fair comparison with a model trained by Sentinel-1 of the same area.

[1]  Xiaoxiang Zhu,et al.  Land consumption in cities: A comparative study across the globe , 2021 .

[2]  Joseph Y. Cheng,et al.  Analysis of deep complex‐valued convolutional neural networks for MRI reconstruction and phase‐focused applications , 2021, Magnetic resonance in medicine.

[3]  Xiao Xiang Zhu,et al.  Multilevel Feature Fusion-Based CNN for Local Climate Zone Classification From Sentinel-2 Images: Benchmark Results on the So2Sat LCZ42 Dataset , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  Rong Yang,et al.  A Novel Polarimetric SAR Classification Method Integrating Pixel-Based and Patch-Based Classification , 2020, IEEE Geoscience and Remote Sensing Letters.

[5]  Xiaohua Li,et al.  A Novel Multi-Feature Joint Learning Method for Fast Polarimetric SAR Terrain Classification , 2020, IEEE Access.

[6]  Xiao Xiang Zhu,et al.  So2Sat LCZ42: A Benchmark Dataset for Global Local Climate Zones Classification , 2019, ArXiv.

[7]  Yangbo Chen,et al.  A Novel PolSAR Image Classification Method Based on Optimal Polarimetric Features and Contextual Information , 2019, Canadian Journal of Remote Sensing.

[8]  Biao Hou,et al.  CNN-Based Polarimetric Decomposition Feature Selection for PolSAR Image Classification , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Yue Zhang,et al.  Effective Classification of Local Climate Zones Based on Multi-Source Remote Sensing Data , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[10]  Pengming Feng,et al.  Embranchment Cnn Based Local Climate Zone Classification Using Sar And Multispectral Remote Sensing Data , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[11]  Lamei Zhang,et al.  Efficiently utilizing complex-valued PolSAR image data via a multi-task deep learning framework , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[12]  Linda See,et al.  Generating WUDAPT Level 0 data – Current status of production and evaluation , 2019, Urban Climate.

[13]  Shuiping Gou,et al.  Self-Paced Convolutional Neural Network for PolSAR Images Classification , 2019, Remote. Sens..

[14]  Kyung-shik Shin,et al.  Hierarchical convolutional neural networks for fashion image classification , 2019, Expert Syst. Appl..

[15]  Patrick Virtue,et al.  Complex-valued Deep Learning with Applications to Magnetic Resonance Image Synthesis , 2019 .

[16]  Xiao Xiang Zhu,et al.  Feature Extraction and Selection of Sentinel-1 Dual-Pol Data for Global-Scale Local Climate Zone Classification , 2018, ISPRS Int. J. Geo Inf..

[17]  Daniel G. Aliaga,et al.  WUDAPT: An Urban Weather, Climate, and Environmental Modeling Infrastructure for the Anthropocene , 2018, Bulletin of the American Meteorological Society.

[18]  Xin Xu,et al.  Multi-Pixel Simultaneous Classification of PolSAR Image Using Convolutional Neural Networks , 2018, Sensors.

[19]  Daniel Fenner,et al.  Micro-Scale Variability of Air Temperature within a Local Climate Zone in Berlin, Germany, during Summer , 2018 .

[20]  Sandeep Subramanian,et al.  Deep Complex Networks , 2017, ICLR.

[21]  Weidong Yu,et al.  The SAR Payload Design and Performance for the GF-3 Mission , 2017, Sensors.

[22]  Michael Bain,et al.  B-CNN: Branch Convolutional Neural Network for Hierarchical Classification , 2017, ArXiv.

[23]  Haipeng Wang,et al.  Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Edward Ng,et al.  Spatial Variability of Geriatric Depression Risk in a High ‐ Density City : A Data ‐ Driven Socio ‐ Environmental Vulnerability Mapping , 2022 .

[25]  Stella X. Yu,et al.  Better than real: Complex-valued neural nets for MRI fingerprinting , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[26]  Eberhard Parlow,et al.  Attribution of local climate zones using a multitemporal land use/land cover classification scheme , 2017 .

[27]  Meng Cai,et al.  Classification of Local Climate Zones Using ASTER and Landsat Data for High-Density Cities , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Yu Zhou,et al.  Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[29]  Meng Yang,et al.  Large-Margin Softmax Loss for Convolutional Neural Networks , 2016, ICML.

[30]  Steffen Fritz,et al.  Contributing to WUDAPT: A Local Climate Zone Classification of Two Cities in Ukraine , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Benjamin Bechtel,et al.  Classification of Local Climate Zones Using SAR and Multispectral Data in an Arid Environment , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Iain Stewart,et al.  Mapping Local Climate Zones for a Worldwide Database of the Form and Function of Cities , 2015, ISPRS Int. J. Geo Inf..

[33]  Robinson Piramuthu,et al.  HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[34]  T. Oke,et al.  Local Climate Zones for Urban Temperature Studies , 2012 .

[35]  Yoshio Yamaguchi,et al.  Filtering of polarimetric synthetic aperture radar images: A sequential approach , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.