Detection of Informal Settlements from VHR Images Using Convolutional Neural Networks

Information about the location and extent of informal settlements is necessary to guide decision making and resource allocation for their upgrading. Very high resolution (VHR) satellite images can provide this useful information, however, different urban settlement types are hard to be automatically discriminated and extracted from VHR imagery, because of their abstract semantic class definition. State-of-the-art classification techniques rely on hand-engineering spatial-contextual features to improve the classification results of pixel-based methods. In this paper, we propose to use convolutional neural networks (CNNs) for learning discriminative spatial features, and perform automatic detection of informal settlements. The experimental analysis is carried out on a QuickBird image acquired over Dar es Salaam, Tanzania. The proposed technique is compared against support vector machines (SVMs) using texture features extracted from grey level co-occurrence matrix (GLCM) and local binary patterns (LBP), which result in accuracies of 86.65% and 90.48%, respectively. CNN leads to better classification, resulting in an overall accuracy of 91.71%. A sensitivity analysis shows that deeper networks result in higher accuracies when large training sets are used. The study concludes that training CNN in an end-to-end fashion can automatically learn spatial features from the data that are capable of discriminating complex urban land use classes.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Brian P. Salmon,et al.  Multiview Deep Learning for Land-Use Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[3]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[4]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[5]  Jon Atli Benediktsson,et al.  Advances in Spectral-Spatial Classification of Hyperspectral Images , 2013, Proceedings of the IEEE.

[6]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[7]  Guido Rossum,et al.  Python Reference Manual , 2000 .

[8]  Geoffrey E. Hinton,et al.  Machine Learning for Aerial Image Labeling , 2013 .

[9]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jamie Sherrah,et al.  Semantic Labeling of Aerial and Satellite Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[12]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[14]  Amy Loutfi,et al.  Classification and Segmentation of Satellite Orthoimagery Using Convolutional Neural Networks , 2016, Remote. Sens..

[15]  Adriaan van Niekerk,et al.  Implications of land use change for the sustainability of urban areas: A case study of Stellenbosch, South Africa , 2013 .

[16]  Monika Kuffer,et al.  The development of a morphological unplanned settlement index using very-high-resolution (VHR) imagery , 2014, Comput. Environ. Urban Syst..

[17]  Alfred Stein,et al.  Uncertainty analysis for image interpretations of urban slums , 2016, Comput. Environ. Urban Syst..

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Arif Hasan,et al.  Orangi Pilot Project: the expansion of work beyond Orangi and the mapping of informal settlements and infrastructure , 2006 .

[20]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[21]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[22]  Christopher K. I. Williams,et al.  Transformation Equivariant Boltzmann Machines , 2011, ICANN.

[23]  L. Marais,et al.  The upgrading of an informal settlement in South Africa: Two decades onwards , 2013 .

[24]  Rob Fergus,et al.  Stochastic Pooling for Regularization of Deep Convolutional Neural Networks , 2013, ICLR.

[25]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Anil M. Cheriyadat,et al.  Image Based Characterization of Formal and Informal Neighborhoods in an Urban Landscape , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[27]  Frans van den Bergh,et al.  A Comparison of Texture Feature Algorithms for Urban Settlement Classification , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Wei Lee Woon,et al.  Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks , 2017 .

[29]  Uwe Stilla,et al.  Deep Learning Earth Observation Classification Using ImageNet Pretrained Networks , 2016, IEEE Geoscience and Remote Sensing Letters.

[30]  Irene Karanja,et al.  An enumeration and mapping of informal settlements in Kisumu, Kenya, implemented by their inhabitants , 2010 .

[31]  P. Ward.  Housing rehab for consolidated informal settlements: A new policy agenda for 2016 UN-Habitat III , 2015 .

[32]  M. Kuffer,et al.  Urban morphology of unplanned settlements: the use of spatial metrics in VHR remotely sensed images , 2011 .

[33]  R. V. Sliuzas,et al.  Managing Informal Settlements : A Study Using Geo-Information in Dar es Salaam, Tanzania , 1999 .

[34]  Michele Volpi,et al.  Dense Semantic Labeling of Subdecimeter Resolution Images With Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[36]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Richard Sliuzas,et al.  Opportunities for enhancing communication in settlement upgrading with geographic information technology-based support tools , 2003 .

[38]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[39]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[40]  Matti Pietikäinen,et al.  A Generalized Local Binary Pattern Operator for Multiresolution Gray Scale and Rotation Invariant Texture Classification , 2001, ICAPR.

[41]  Monika Kuffer,et al.  Extraction of Slum Areas From VHR Imagery Using GLCM Variance , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Thomas Esch,et al.  Towards EO-based sustainable urban planning and management , 2013, 2013 IEEE International Geoscience and Remote Sensing Symposium - IGARSS.

[43]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[44]  Oleksandr Kit,et al.  Texture-based identification of urban slums in Hyderabad, India using remote sensing data , 2012 .

[45]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[46]  John Abbott,et al.  An analysis of informal settlement upgrading and critique of existing methodological approaches , 2002 .

[47]  C. H. Chen,et al.  Handbook of Pattern Recognition and Computer Vision , 1993 .

[48]  Claudio Persello,et al.  A deep learning approach to the classification of sub-decimetre resolution aerial images , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[49]  Sulochana Shekhar,et al.  DETECTING SLUMS FROM QUICK BIRD DATA IN PUNE USING AN OBJECT ORIENTED APPROACH , 2012 .

[50]  Igor Sevo,et al.  Convolutional Neural Network Based Automatic Object Detection on Aerial Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[51]  Russell G. Congalton,et al.  A review of assessing the accuracy of classifications of remotely sensed data , 1991 .

[52]  Andrew L. Maas.  Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[53]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[54]  J. M. Lusugga Kironde,et al.  The regulatory framework, unplanned development and urban poverty: Findings from Dar es Salaam, Tanzania , 2006 .

[55]  P. Hofmann,et al.  Detecting informal settlements from QuickBird data in Rio de Janeiro using an object based approach , 2008 .

[56]  David W. S. Wong,et al.  An approach to differentiate informal settlements using spectral, texture, geomorphology and road accessibility metrics , 2013 .