The Temporal Dynamics of Slums Employing a CNN-Based Change Detection Approach

Along with rapid urbanization, the growth and persistence of slums is a global challenge. While remote sensing imagery is increasingly used for producing slum maps, only a few studies have analyzed their temporal dynamics. This study explores the potential of fully convolutional networks (FCNs) to analyze the temporal dynamics of small clusters of temporary slums using very high resolution (VHR) imagery in Bangalore, India. The study develops two approaches based on FCNs. The first approach uses a post-classification change detection, and the second trains FCNs to directly classify the dynamics of slums. For both approaches, the performances of 3 × 3 kernels and 5 × 5 kernels of the networks were compared. While classification results of individual years exhibit a relatively high F1-score (3 × 3 kernel) of 88.4% on average, the change accuracies are lower. The post-classification results obtained an F1-score of 53.8% and the change-detection networks obtained an F1-score of 53.7%. According to the trajectory error matrix (TEM), the post-classification results scored higher for the overall accuracy but lower for the accuracy difference of change trajectories than the change-detection networks. Although the two methods did not have significant differences in terms of accuracy, the change-detection network was less noisy. Within our study area, the areas of slums show a small overall decrease; the annual growth of slums (between 2012 and 2016) was 7173 m2, in contrast to an annual decline of 8390 m2. However, these numbers hid the spatial dynamics, which were much larger. Interestingly, areas where slums disappeared commonly changed into green areas, not into built-up areas. The proposed change-detection network provides a robust map of the locations of changes with lower confidence about the exact boundaries. This shows the potential of FCNs for detecting the dynamics of slums in VHR imagery.

[1]  Oleksandr Kit,et al.  Automated detection of slum area change in Hyderabad, India using multitemporal satellite imagery , 2013 .

[2]  Alfred Stein,et al.  An ontology of slums for image-based classification , 2012, Comput. Environ. Urban Syst..

[3]  Weiwei Sun,et al.  Fully Convolutional Networks for Semantic Segmentation of Very High Resolution Remotely Sensed Images Combined With DSM , 2018, IEEE Geoscience and Remote Sensing Letters.

[4]  Klaus Greve,et al.  Simulating slum growth in Lagos: An integration of rule based and empirical based model , 2019, Comput. Environ. Urban Syst..

[5]  Gang Fu,et al.  Classification for High Resolution Remote Sensing Imagery Using a Fully Convolutional Network , 2017, Remote. Sens..

[6]  Hui Liu,et al.  The Use of Landscape Metrics and Transfer Learning to Explore Urban Villages in China , 2017, Remote. Sens..

[7]  Julien Radoux,et al.  Good Practices for Object-Based Accuracy Assessment , 2017, Remote. Sens..

[8]  Krithi Ramamritham,et al.  Transfer learning approach to map urban slums using high and medium resolution satellite imagery , 2019, Habitat International.

[9]  Alfred Stein,et al.  Uncertainty analysis for image interpretations of urban slums , 2016, Comput. Environ. Urban Syst..

[10]  Jamie Sherrah,et al.  Semantic Labeling of Aerial and Satellite Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[11]  Jiong Wang,et al.  Deprivation pockets through the lens of convolutional neural networks , 2019, Remote Sensing of Environment.

[12]  Alfred Stein,et al.  Deep Fully Convolutional Networks for the Detection of Informal Settlements in VHR Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Alfred Stein,et al.  Transferability of Object-Oriented Image Analysis Methods for Slum Identification , 2013, Remote. Sens..

[14]  Monika Kuffer,et al.  Extraction of Slum Areas From VHR Imagery Using GLCM Variance , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[16]  Qiming Zhou,et al.  Accuracy assessment on multi‐temporal land‐cover change detection using a trajectory error matrix , 2009 .

[17]  Alfred Stein,et al.  Recurrent Multiresolution Convolutional Networks for VHR Image Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Monika Kuffer,et al.  The Scope of Earth-Observation to Improve the Consistency of the SDG Slum Indicator , 2018, ISPRS Int. J. Geo Inf..

[19]  Anirudh Krishna,et al.  Slum types and adaptation strategies: identifying policy-relevant differences in Bangalore , 2014 .

[20]  Monika Kuffer,et al.  Application of the trajectory error matrix for assessing the temporal transferability of OBIA for slum detection , 2018 .

[21]  G. Foody Assessing the accuracy of land cover change with imperfect ground reference data , 2010 .

[22]  Monika Kuffer,et al.  Slums from Space - 15 Years of Slum Mapping Using Remote Sensing , 2016, Remote. Sens..

[23]  Peter M. A. Sloot,et al.  Spatial segregation, inequality, and opportunity bias in the slums of Bengaluru , 2017 .

[24]  Monika Kuffer,et al.  Identifying a Slums' Degree of Deprivation from VHR Images Using Convolutional Neural Networks , 2019, Remote. Sens..

[25]  P. Agouris,et al.  The study of slums as social and physical constructs: challenges and emerging research opportunities , 2016 .

[26]  Monika Kuffer,et al.  Image based classification of slums, built-up and non-built-up areas in Kalyan and Bangalore, India , 2018, European Journal of Remote Sensing.

[27]  Alfred Stein,et al.  Detection of Informal Settlements from VHR Images Using Convolutional Neural Networks , 2017, Remote. Sens..

[28]  Alejandro Betancourt,et al.  Exploring the Potential of Machine Learning for Automatic Slum Identification from VHR Imagery , 2017, Remote. Sens..

[29]  Qing Wang,et al.  Change detection based on Faster R-CNN for high-resolution remote sensing images , 2018, Remote Sensing Letters.

[30]  Xiao Xiang Zhu,et al.  Semantic segmentation of slums in satellite images using transfer learning on fully convolutional neural networks , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.