Embranchment Cnn Based Local Climate Zone Classification Using Sar And Multispectral Remote Sensing Data

In this study, a Local Climate Zone (LCZ) classification framework is established using a Densenet based embranchment Convolutional Neural Network (CNN). Both synthetic aperture radar (SAR) and multispectral data are employed for feature fusion, specifically, considering about the difference in imaging mechanism between SAR and multispectral data, features from both resources are extracted in different branches separately according to the physical properties of each band. Significant accuracy improvement can be achieved when evaluate the proposed method by Sentinel-1 and Sentinel-2 dataset, and the comparison results show the superiority of the proposed embranchment CNN framework over the conventional methods.

[1]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[3]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[4]  Marc Simard,et al.  Mapping Migratory Bird Prevalence Using Remote Sensing Data Fusion , 2012, PloS one.

[5]  T. Oke,et al.  Local Climate Zones for Urban Temperature Studies , 2012 .

[6]  Xiao Xiang Zhu,et al.  The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion , 2018, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[7]  Xiao Xiang Zhu,et al.  Feature Extraction and Selection of Sentinel-1 Dual-Pol Data for Global-Scale Local Climate Zone Classification , 2018, ISPRS Int. J. Geo Inf..

[8]  Xiao Xiang Zhu,et al.  Feature Importance Analysis for Local Climate Zone Classification Using a Residual Convolutional Neural Network with Multi-Source Datasets , 2018, Remote. Sens..

[9]  N. A. Brunsell,et al.  Using local climate zone classifications to assess the influence of urban morphology on the urban heat island effect , 2017 .

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.