Humanitarian applications of machine learning with remote-sensing data: review and case study in refugee settlement mapping

The coordination of humanitarian relief, e.g. in a natural disaster or a conflict situation, is often complicated by a scarcity of data to inform planning. Remote sensing imagery, from satellites or drones, can give important insights into conditions on the ground, including in areas which are difficult to access. Applications include situation awareness after natural disasters, structural damage assessment in conflict, monitoring human rights violations or population estimation in settlements. We review machine learning approaches for automating these problems, and discuss their potential and limitations. We also provide a case study of experiments using deep learning methods to count the numbers of structures in multiple refugee settlements in Africa and the Middle East. We find that while high levels of accuracy are possible, there is considerable variation in the characteristics of imagery collected from different sensors and regions. In this, as in the other applications discussed in the paper, critical inferences must be made from a relatively small amount of pixel data. We, therefore, consider that using machine learning systems as an augmentation of human analysts is a reasonable strategy to transition from current fully manual operational pipelines to ones which are both more efficient and have the necessary levels of quality control. This article is part of a discussion meeting issue ‘The growing ubiquity of algorithms in society: implications, impacts and innovations’.

[1]  Patrick Aravena Pelizari,et al.  Object-Based Analysis and Fusion of Optical and SAR Satellite Data for Dwelling Detection in Refugee Camps , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[2]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[3]  H. Taubenböck,et al.  The morphology of the Arrival City - A global categorization based on literature surveys and remotely sensed data , 2018 .

[4]  Francesco Checchi,et al.  Validity and feasibility of a satellite imagery-based method for rapid estimation of displaced populations , 2013, International Journal of Health Geographics.

[5]  Yang Shao,et al.  Detection of Urban Damage Using Remote Sensing and Machine Learning Algorithms: Revisiting the 2010 Haiti Earthquake , 2016, Remote. Sens..

[6]  E. Prins,et al.  Use of low cost Landsat ETM+ to spot burnt villages in Darfur, Sudan , 2008 .

[7]  Timothy A. Warner,et al.  Implementation of machine-learning classification in remote sensing: an applied review , 2018 .

[8]  Samuel N. Goward,et al.  Remote Sensing in Human Rights and International Humanitarian Law Monitoring: Concepts and Methods† , 2013 .

[9]  Bartel Van de Walle,et al.  Humanitarian Information Management and Systems , 2008, Mobile Response.

[10]  Eileen Baldry,et al.  Predictable and preventable , 2016 .

[11]  Krzysztof Janowicz,et al.  Prioritizing Disaster Mapping Tasks for Online Volunteers Based on Information Value Theory , 2017 .

[12]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[13]  Martino Pesaresi,et al.  Systematic Study of the Urban Postconflict Change Classification Performance Using Spectral and Structural Features in a Support Vector Machine , 2008, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Pierre Soille,et al.  Enumeration of Dwellings in Darfur Camps From GeoEye-1 Satellite Images Using Mathematical Morphology , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Dirk Tiede,et al.  Earth observation (EO)-based ex post assessment of internally displaced person (IDP) camp evolution and population dynamics in Zam Zam, Darfur , 2010 .

[16]  E. Bjorgo Using very high spatial resolution multispectral satellite sensor imagery to monitor refugee camps , 2000 .

[17]  Edzer Pebesma,et al.  Combining automatic and manual image analysis in a web-mapping application for collaborative conflict damage assessment , 2018, Applied Geography.

[18]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[19]  Edzer Pebesma,et al.  Detecting dwelling destruction in Darfur through object-based change analysis of very high-resolution imagery , 2017 .

[20]  Deren Li,et al.  Can night-time light images play a role in evaluating the Syrian Crisis? , 2014 .

[21]  Giancarlo Santilli,et al.  CubeSat constellations for disaster management in remote areas , 2018 .

[22]  Dirk Tiede,et al.  Earth Observation-Based Dwelling Detection Approaches in a Highly Complex Refugee Camp Environment - A Comparative Study , 2014, Remote. Sens..

[23]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  F. Witmer Remote sensing of violent conflict: eyes from above , 2015 .

[25]  Hannes Taubenböck,et al.  Multi-sensor feature fusion for very high spatial resolution built-up area extraction in temporary settlements , 2018 .

[26]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[27]  Dirk Tiede,et al.  Monitoring Refugee/IDP Camps to Support International Relief Action , 2010 .

[28]  J. O’Loughlin,et al.  Detecting the Effects of Wars in the Caucasus Regions of Russia and Georgia Using Radiometrically Normalized DMSP-OLS Nighttime Lights Imagery , 2011 .

[29]  Tong Zhang,et al.  Deep Learning Based Feature Selection for Remote Sensing Scene Classification , 2015, IEEE Geoscience and Remote Sensing Letters.

[30]  Andrew Marx,et al.  Landsat-based early warning system to detect the destruction of villages in Darfur, Sudan , 2013 .

[31]  Rodrigo Minetto,et al.  Hydra: An Ensemble of Convolutional Neural Networks for Geospatial Land Classification , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Jungho Im,et al.  ISPRS Journal of Photogrammetry and Remote Sensing , 2022 .

[33]  Lars Bromley,et al.  Relating violence to MODIS fire detections in Darfur, Sudan , 2010 .

[34]  P. Soille,et al.  Information extraction from very high resolution satellite imagery over Lukole refugee camp, Tanzania , 2003 .

[35]  Monika Kuffer,et al.  Slums from Space - 15 Years of Slum Mapping Using Remote Sensing , 2016, Remote. Sens..

[36]  D. Cole,et al.  A systematic review of the application and utility of geographical information systems for exploring disease-disease relationships in paediatric global health research: the case of anaemia and malaria , 2013, International Journal of Health Geographics.

[37]  Kemper Thomas,et al.  Use of New coastal spectral band for precise dwelling extraction in the Hagadera refugee camp , 2014 .

[38]  Dirk Tiede,et al.  Stratified Template Matching to Support Refugee Camp Analysis in OBIA Workflows , 2017, Remote. Sens..

[39]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Shifeng Wang,et al.  Detecting tents to estimate the displaced populations for post-disaster relief using high resolution satellite imagery , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[41]  Emma Lochery,et al.  Violence and Exodus in Kenya's Rift Valley, 2008: Predictable and Preventable? , 2008 .

[42]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).