Measuring Urban Deprivation from User Generated Content

Measuring socioeconomic deprivation of cities in an accurate and timely fashion has become a priority for governments around the world, as the massive urbanization process we are witnessing is causing high levels of inequalities which require intervention. Traditionally, deprivation indexes have been derived from census data, which is however very expensive to obtain, and thus acquired only every few years. Alternative computational methods have been proposed in recent years to automatically extract proxies of deprivation at a fine spatio-temporal level of granularity; however, they usually require access to datasets (e.g., call details records) that are not publicly available to governments and agencies. To remedy this, we propose a new method to automatically mine deprivation at a fine level of spatio-temporal granularity that only requires access to freely available user-generated content. More precisely, the method needs access to datasets describing what urban elements are present in the physical environment; examples of such datasets are Foursquare and OpenStreetMap. Using these datasets, we quantitatively describe neighborhoods by means of a metric, called Offering Advantage, that reflects which urban elements are distinctive features of each neighborhood. We then use that metric to (i) build accurate classifiers of urban deprivation and (ii) interpret the outcomes through thematic analysis. We apply the method to three UK urban areas of different scale and elaborate on the results in terms of precision and recall.

[1]  Daniele Quercia,et al.  Mining Urban Deprivation from Foursquare: Implicit Crowdsourcing of City Land Use , 2014, IEEE Pervasive Computing.

[2]  Karen Witten,et al.  Neighborhood deprivation and access to fast-food retailing: a national study. , 2007, American journal of preventive medicine.

[3]  John Zimmerman,et al.  I'm the mayor of my house: examining why people use foursquare - a social-driven location sharing application , 2011, CHI.

[4]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[5]  C. Dibben,et al.  The English indices of deprivation 2004 , 2011 .

[6]  D Locker,et al.  Deprivation and oral health: a review. , 2000, Community dentistry and oral epidemiology.

[7]  W. Tobler A Computer Movie Simulating Urban Growth in the Detroit Region , 1970 .

[8]  M. Small,et al.  The Presence of Organizational Resources in Poor Urban Neighborhoods:An Analysis of Average and Contextual Effects , 2006 .

[9]  Daniele Quercia,et al.  Talk of the City: Our Tweets, Our Community Happiness , 2012, ICWSM.

[10]  F. Chaloupka,et al.  Availability of physical activity-related facilities and neighborhood demographic and socioeconomic characteristics: a national study. , 2006, American journal of public health.

[11]  L. Mckay,et al.  McDonald's restaurants and neighborhood deprivation in Scotland and England. , 2005, American journal of preventive medicine.

[12]  R. G. Davies,et al.  Urban form, biodiversity potential and ecosystem services , 2007 .

[13]  Sebastian Fischer Non Standard Spatial Statistics And Spatial Econometrics , 2016 .

[14]  Giovanni Quattrone,et al.  Putting ubiquitous crowd-sourcing into context , 2013, CSCW '13.

[15]  Noelwah R. Netusil,et al.  The impact of open spaces on property values in Portland, Oregon , 2000 .

[16]  Giovanni Quattrone,et al.  There's No Such Thing as the Perfect Map: Quantifying Bias in Spatial Crowd-sourcing Datasets , 2015, CSCW.

[17]  B. Giles-Corti,et al.  Socioeconomic status differences in recreational physical activity levels and real and perceived access to a supportive physical environment. , 2002, Preventive medicine.

[18]  C. Elvidge,et al.  Mapping City Lights With Nighttime Data from the DMSP Operational Linescan System , 1997 .

[19]  Allan J. Brimicombe,et al.  Ethnicity, Religion, and Residential Segregation in London: Evidence from a Computational Typology of Minority Communities , 2007 .

[20]  Daniele Quercia,et al.  Finger on the pulse: identifying deprivation using transit flow analysis , 2013, CSCW.

[21]  A. Tatem,et al.  Using remotely sensed night-time light as a proxy for poverty in Africa , 2008, Population health metrics.

[22]  C. Elvidge,et al.  Night-time lights of the world: 1994–1995 , 2001 .

[23]  P. Legendre Spatial Autocorrelation: Trouble or New Paradigm? , 1993 .

[24]  Daniele Quercia,et al.  Tracking "gross community happiness" from tweets , 2012, CSCW.

[25]  N. Eagle,et al.  Network Diversity and Economic Development , 2010, Science.

[26]  M. Alberti The Effects of Urban Patterns on Ecosystem Function , 2005 .

[27]  John D. Storey,et al.  Statistical significance for genomewide studies , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Kate E. Jones,et al.  Global distribution and conservation of rare and threatened vertebrates , 2006, Nature.

[29]  Robert J. Sampson,et al.  Divergent Pathways of Gentrification , 2014 .

[30]  G. Mboup,et al.  State of the worlds cities 2008 / 2009. Harmonious cities. , 2008 .

[31]  Giovanni Quattrone,et al.  Mind the map: the impact of culture and economic affluence on crowd-mapping behaviours , 2014, CSCW.

[32]  J. Luttik The value of trees, water and open space as reflected by house prices in the Netherlands , 2000 .

[33]  D Hémon,et al.  Assessing the significance of the correlation between two spatial processes. , 1989, Biometrics.

[34]  R. Scribner,et al.  Fast food, race/ethnicity, and income: a geographic analysis. , 2004, American journal of preventive medicine.

[35]  Norman M. Sadeh,et al.  The Livehoods Project: Utilizing Social Media to Understand the Dynamics of a City , 2012, ICWSM.

[36]  J. Geoghegan The value of open spaces in residential land use , 2002 .

[37]  César A. Hidalgo,et al.  The Product Space Conditions the Development of Nations , 2007, Science.

[38]  B. Hillier,et al.  The Social Logic of Space , 1984 .

[39]  Henriette Cramer,et al.  Aesthetic capital: what makes london look beautiful, quiet, and happy? , 2014, CSCW.

[40]  L. Capra,et al.  Ubiquitous Sensing for Mapping Poverty in Developing Countries , 2013 .