Semi-Supervised Multitask Learning on Multispectral Satellite Images Using Wasserstein Generative Adversarial Networks (GANs) for Predicting Poverty

Obtaining reliable data describing local poverty metrics at a granularity that is informative to policy-makers requires expensive and logistically difficult surveys, particularly in the developing world. Not surprisingly, the poverty stricken regions are also the ones which have a high probability of being a war zone, have poor infrastructure and sometimes have governments that do not cooperate with internationally funded development efforts. We train a CNN on free and publicly available daytime satellite images of the African continent from Landsat 7 to build a model for predicting local economic livelihoods. Only 5% of the satellite images can be associated with labels (which are obtained from DHS Surveys) and thus a semi-supervised approach using a GAN (similar to the approach of Salimans, et al. (2016)), albeit with a more stable-to-train flavor of GANs called the Wasserstein GAN regularized with gradient penalty(Gulrajani, et al. (2017)) is used. The method of multitask learning is employed to regularize the network and also create an end-to-end model for the prediction of multiple poverty metrics.

[1]  P. Sutton,et al.  SPECIAL ISSUE: The Dynamics and Value of Ecosystem Services: Integrating Economic and Ecological Perspectives Global estimates of market and non-market values derived from nighttime satellite imagery, land cover, and ecosystem service valuation , 2002 .

[2]  Gerald Nelson,et al.  Do Roads Cause Deforestation? Using Satellite Images in Econometric Analysis of Land Use , 1997 .

[3]  H. Shimodaira,et al.  Improving predictive inference under covariate shift by weighting the log-likelihood function , 2000 .

[4]  N. Taleb,et al.  Recent Trends in Satellite Image Pan- sharpening techniques , 2014 .

[5]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[6]  J. Muller,et al.  Mapping regional economic activity from night-time light satellite imagery , 2006 .

[7]  Morten Jerven,et al.  Poor Numbers: How We Are Misled by African Development Statistics and What to Do about It , 2013 .

[8]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[9]  Juan Manuel Torres,et al.  Paying for the hydrological services of Mexico's forests: Analysis, negotiations and results , 2008 .

[10]  T. Carlson,et al.  An assessment of satellite remotely-sensed land cover parameters in quantitatively describing the climatic effect of urbanization , 1998 .

[11]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[12]  Swetava Ganguli,et al.  GeoGAN: A Conditional GAN with Reconstruction and Style Loss to Generate Standard Layer of Maps from Satellite Images , 2019, ArXiv.

[13]  Kamaruzzaman Sopian,et al.  A new approach for predicting solar radiation in tropical environment using satellite images - Case study of Malaysia , 2008 .

[14]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[15]  Valentijn Venus,et al.  Mangrove vulnerability modelling in parts of Western Niger Delta, Nigeria using satellite images, GIS techniques and Spatial Multi-Criteria Analysis (SMCA) , 2011, Environmental monitoring and assessment.

[16]  Yoshua Bengio,et al.  Generative Adversarial Networks , 2014, ArXiv.

[17]  Sang Michael Xie,et al.  Combining satellite imagery and machine learning to predict poverty , 2016, Science.

[18]  Jake Badger,et al.  Using modeling, satellite images and existing global datasets for rapid preliminary assessments of renewable energy resources: The case of Mali , 2010 .

[19]  Jared Dunnmon,et al.  Predicting US State-Level Agricultural Sentiment as a Measure of Food Security with Tweets from Farming Communities , 2019, ArXiv.

[20]  Stefano Ermon,et al.  Hybrid Deep Discriminative/Generative Models for Semi-Supervised Learning , 2017, UAI.

[21]  Dwyer Edward,et al.  A Global Analysis of Vegetation Fires Using Satellite Images: Spatial and Temporal Dynamics. , 1998 .

[22]  Jared Dunnmon,et al.  Predicting Food Security Outcomes Using Convolutional Neural Networks (CNNs) for Satellite Tasking , 2019, ArXiv.

[23]  K. Seto,et al.  A Meta-Analysis of Global Urban Land Expansion , 2011, PloS one.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[26]  Carlo Gatta,et al.  Unsupervised deep feature extraction of hyperspectral images , 2014, 2014 6th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS).