Targeting Development Aid with Machine Learning and Mobile Phone Data: Evidence from an Anti-Poverty Intervention in Afghanistan

Recent papers demonstrate that non-traditional data, from mobile phones and other digital sensors, can be used to roughly estimate the wealth of individual subscribers. This paper asks a question more directly relevant to development policy: Can non-traditional data be used to more efficiently target development aid? By combining rich survey data from a "big push" anti-poverty program in Afghanistan with detailed mobile phone logs from program beneficiaries, we study the extent to which machine learning methods can accurately differentiate ultra-poor households eligible for program benefits from other households deemed ineligible. We show that supervised learning methods leveraging mobile phone data can identify ultra-poor households as accurately as standard survey-based measures of poverty, including consumption and wealth; and that combining survey-based measures with mobile phone data produces classifications more accurate than those based on a single data source. We discuss the implications and limitations of these methods for targeting extreme poverty in marginalized populations.

[1]  C. Murray,et al.  Measuring health inequality , 2009 .

[2]  Gabriel Cadamuro,et al.  Predicting poverty and wealth from mobile phone metadata , 2015, Science.

[3]  H. Michelson,et al.  Measuring Socio-economic Status in the Millennium Villages: The Role of Asset Index Choice , 2013 .

[4]  Stefano Ermon,et al.  Predicting Economic Development using Geolocated Wikipedia Articles , 2019, KDD.

[5]  L. Taylor No place to hide? The ethics and analytics of tracking mobility using mobile phone data , 2016 .

[6]  Timo Schmid,et al.  Constructing sociodemographic indicators for national statistical institutes by using mobile phone data: estimating literacy rates in Senegal , 2017 .

[7]  Bruce D. Meyer,et al.  Household Surveys in Crisis , 2015 .

[8]  Joshua E. Blumenstock,et al.  Manipulation-Proof Machine Learning , 2019, AEA Randomized Controlled Trials.

[9]  Joshua Blumenstock,et al.  Estimating Economic Characteristics with Phone Data , 2018 .

[10]  Joshua Blumenstock,et al.  Fighting poverty with data , 2016, Science.

[11]  Vijayendra Rao,et al.  THE WORLD BANK ECONOMIC REVIEW , 2012 .

[12]  J. Baker,et al.  Proxy Means Tests for Targeting Social Programs: Simulations and Speculation , 2009 .

[13]  J. Mackenbach,et al.  Measuring health inequality among children in developing countries: does the choice of the indicator of economic status matter? , 2003, International journal for equity in health.

[14]  A. Wagstaff,et al.  What difference does the choice of SES make in health inequality measurement? , 2003, Health economics.

[15]  P. Wachtel,et al.  No Household Left Behind: Afghanistan Targeting the Ultra Poor Impact Evaluation , 2019 .

[16]  A. Banerjee,et al.  Targeting the Poor: Evidence from a Field Experiment in Indonesia , 2010, The American economic review.

[17]  Rema Hanna,et al.  Universal Basic Incomes vs. Targeted Transfers: Anti-Poverty Programs in Developing Countries , 2018, Journal of Economic Perspectives.

[18]  Caitlin Brown,et al.  Smart Hedging against Carbon Leakage , 2015, Economic Policy.

[19]  Alex 'Sandy' Pentland,et al.  bandicoot: a Python Toolbox for Mobile Phone Metadata , 2016, J. Mach. Learn. Res..

[20]  L. Pritchett,et al.  Estimating Wealth Effects Without Expenditure Data—Or Tears: An Application To Educational Enrollments In States Of India* , 2001, Demography.

[21]  Dean S. Karlan,et al.  Targeting Ultra-Poor Households in Honduras and Peru , 2013 .

[22]  Xin Lu,et al.  Mapping poverty using mobile phone and satellite data , 2017, Journal of The Royal Society Interface.

[23]  John Hoddinott,et al.  Targeting outcomes redux , 2004 .

[24]  Sriganesh Lokanathan,et al.  Understanding the Impact of Urban Infrastructure: New Insights from Population-Scale Data , 2017, ICTD.

[25]  Vincent D. Blondel,et al.  Estimating Food Consumption and Poverty Indices with Mobile Phone Data , 2014, ArXiv.

[26]  Joshua Blumenstock,et al.  Machine learning can help get COVID-19 aid to those who need it most , 2020, Nature.

[27]  Daniel B. Neill,et al.  Machine Learning for the Developing World , 2018, ACM Trans. Manag. Inf. Syst..