Mapping and Discriminating Rural Settlements Using Gaofen-2 Images and a Fully Convolutional Network

New ongoing rural construction has resulted in an extensive mixture of new settlements with old ones in the rural areas of China. Understanding the spatial characteristic of these rural settlements is of crucial importance as it provides essential information for land management and decision-making. Despite a great advance in High Spatial Resolution (HSR) satellite images and deep learning techniques, it remains a challenging task for mapping rural settlements accurately because of their irregular morphology and distribution pattern. In this study, we proposed a novel framework to map rural settlements by leveraging the merits of Gaofen-2 HSR images and representation learning of deep learning. We combined a dilated residual convolutional network (Dilated-ResNet) and a multi-scale context subnetwork into an end-to-end architecture in order to learn high resolution feature representations from HSR images and to aggregate and refine the multi-scale features extracted by the aforementioned network. Our experiment in Tongxiang city showed that the proposed framework effectively mapped and discriminated rural settlements with an overall accuracy of 98% and Kappa coefficient of 85%, achieving comparable and improved performance compared to other existing methods. Our results bring tangible benefits to support other convolutional neural network (CNN)-based methods in accurate and timely rural settlement mapping, particularly when up-to-date ground truth is absent. The proposed method does not only offer an effective way to extract rural settlement from HSR images but open a new opportunity to obtain spatial-explicit understanding of rural settlements.

[1]  Jing Zhang,et al.  Rural Settlement Subdivision by Using Landscape Metrics as Spatial Contextual Information , 2017, Remote. Sens..

[2]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bo Huang,et al.  Transfer Learning With Fully Pretrained Deep Convolution Networks for Land-Use Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[4]  Yueyan Liu,et al.  Land use and land cover classification for rural residential areas in China using soft-probability cascading of multifeatures , 2017 .

[5]  Oleksandr Kit,et al.  Texture-based identification of urban slums in Hyderabad, India using remote sensing data , 2012 .

[6]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[7]  Ying Wang,et al.  Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images , 2017, Remote. Sens..

[8]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[9]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[10]  Lingfeng Wang,et al.  Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[11]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[12]  Yang Wang,et al.  Discrimination of Settlement and Industrial Area Using Landscape Metrics in Rural Region , 2016, Remote. Sens..

[13]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Pengcheng Zhang,et al.  Automatic building extraction from high-resolution aerial images and LiDAR data using gated residual refinement network , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[15]  Neil Flood,et al.  Using a U-net convolutional neural network to map woody vegetation extent from high resolution satellite imagery across Queensland, Australia , 2019, Int. J. Appl. Earth Obs. Geoinformation.

[16]  John Ray Bergado,et al.  Delineation of agricultural fields in smallholder farms from satellite images using fully convolutional networks and combinatorial grouping , 2019, Remote sensing of environment.

[17]  Joanne V. Hall,et al.  Mapping remote rural settlements at 30 m spatial resolution using geospatial data-fusion , 2019, Remote Sensing of Environment.

[18]  Uwe Stilla,et al.  Classification With an Edge: Improving Semantic Image Segmentation with Boundary Detection , 2016, ISPRS Journal of Photogrammetry and Remote Sensing.

[19]  George Vosselman,et al.  Monitoring household upgrading in unplanned settlements with unmanned aerial vehicles , 2020, Int. J. Appl. Earth Obs. Geoinformation.

[20]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[21]  William J. Emery,et al.  Object-Based Convolutional Neural Network for High-Resolution Imagery Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Wei Yuan,et al.  Automatic Building Segmentation of Aerial Imagery Using Multi-Constraint Fully Convolutional Networks , 2018, Remote. Sens..

[23]  Yan-sui Liu,et al.  Spatio-temporal dynamic patterns of farmland and rural settlements in Su–Xi–Chang region: Implications for building a new countryside in coastal China , 2009 .

[24]  Thomas Blaschke,et al.  Geographic Object-Based Image Analysis – Towards a new paradigm , 2014, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[25]  X. X. Zhu,et al.  A framework for large-scale mapping of human settlement extent from Sentinel-2 images via fully convolutional neural networks , 2020, ISPRS journal of photogrammetry and remote sensing : official publication of the International Society for Photogrammetry and Remote Sensing.

[26]  Alfred Stein,et al.  Deep Fully Convolutional Networks for the Detection of Informal Settlements in VHR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[27]  C. Conrad,et al.  Measuring rural settlement expansion in Uzbekistan using remote sensing to support spatial planning , 2015 .

[28]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[29]  Chang-chun Feng,et al.  The Redundancy of Residential Land in Rural China: The evolution process, current status and policy implications , 2018 .

[30]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.