The Spirit of the City

Place ambiance has a huge influence over how we perceive places. Despite its importance, ambiance has been crucially overlooked by urban planners and scientists alike, not least because it is difficult to record and analyze at scale. We explored the possibility of using social media data to reliably map the ambiance of neighborhoods in the entire city of London. To this end, we collected geo-referenced picture tags from Flickr and matched those tags with the words in a newly created ambiance dictionary. In so doing, we made four main contributions: i) map the ambiance of London neighborhoods; ii) ascertain that such a mapping meets residents' expectations, which are derived from a survey we conducted; iii) show that computer vision techniques upon geo-referenced pictures are of predictive power for neighborhood ambiance; and iv) explain each prediction of a neighborhood's ambiance by identifying the picture that best reflects the meaning of that ambiance (e.g., artsy) in that neighborhood (e.g., South Kensington---the richest and most traditional neighborhood---and Shoreditch---among the most progressive and hipster neighborhoods in the city---are both 'artsy' but in very different ways). The combination of the predictive power of mapping ambiance from images and the ability to explain those predictions makes it possible to discover hidden gems across the city at an unprecedented scale.

[1]  Rossano Schifanella,et al.  Smelly Maps: The Digital Life of Urban Smellscapes , 2015, ICWSM.

[2]  Henriette Cramer,et al.  Describing and Understanding Neighborhood Characteristics through Online Social Media , 2015, WWW.

[3]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[4]  Sally Coutts Hiss, Tony. The Experience of Place, a Completely New Way of Looking at and Dealing With Our Radically Changing Cities and Countryside. New York: Alfred A. Knopf Inc, 1990. Illustrations. $30.00 (cloth); $15.00 (paper) , 1992 .

[5]  Nicu Sebe,et al.  Are Safer Looking Neighborhoods More Lively?: A Multimodal Investigation into Urban Life , 2016, ACM Multimedia.

[6]  Nicu Sebe,et al.  The Death and Life of Great Italian Cities: A Mobile Phone Data Perspective , 2016, WWW.

[7]  Samuel D. Gosling,et al.  Like Partying? Your Face Says It All. Predicting the Ambiance of Places with Profile Pictures , 2015, ICWSM.

[8]  Rossano Schifanella,et al.  Chatty maps: constructing sound maps of urban areas from social media data , 2016, Royal Society Open Science.

[9]  William Harispuru Positive distractions in urban ambiance - Exploring the elements that help synthesize our healthy modern experiences , 2012 .

[10]  Samuel D. Gosling,et al.  Can the Ambiance of a Place be Determined by the User Profiles of the People Who Visit It? , 2021, ICWSM.

[11]  David J. Crandall,et al.  Mining photo-sharing websites to study ecological phenomena , 2012, WWW.

[12]  Alexei A. Efros,et al.  What makes Paris look like Paris? , 2015, Commun. ACM.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  S. Milgram Psychological maps of Paris , 1976 .

[15]  Rich Caruana,et al.  An empirical evaluation of supervised learning in high dimensions , 2008, ICML '08.

[16]  Paul Cohen-Portheim The Spirit of London , 2010 .

[17]  Ross Purves,et al.  Exploring place through user-generated content: Using Flickr tags to describe city cores , 2010, J. Spatial Inf. Sci..

[18]  Virgílio A. F. Almeida,et al.  Psychological maps 2.0: a web engagement enterprise starting in London , 2013, WWW.

[19]  Juhani Pallasmaa,et al.  Space, place and atmosphere. Emotion and peripherical perception in architectural experience , 2014 .

[20]  Tao Chen,et al.  Visual Affect Around the World: A Large-scale Multilingual Visual Sentiment Ontology , 2015, ACM Multimedia.

[21]  César A. Hidalgo,et al.  The Collaborative Image of The City: Mapping the Inequality of Urban Perception , 2013, PloS one.

[22]  Ramesh Raskar,et al.  Deep Learning the City: Quantifying Urban Perception at a Global Scale , 2016, ECCV.

[23]  Myriam Servières,et al.  Mobile Devices and Urban Ambiances: How Connected Wearable Tools Change the Ways We Perceive and Design Public Spaces , 2017 .

[24]  Henriette Cramer,et al.  Aesthetic capital: what makes london look beautiful, quiet, and happy? , 2014, CSCW.

[25]  Licia Capra,et al.  Community Question Answering Platforms vs. Twitter for Predicting Characteristics of Urban Neighbourhoods , 2017, ArXiv.

[26]  Zeynep Tufekci,et al.  Big Questions for Social Media Big Data: Representativeness, Validity and Other Methodological Pitfalls , 2014, ICWSM.

[27]  S. Milgram The experience of living in cities. , 1970, Science.

[28]  Ramesh Raskar,et al.  Computer vision uncovers predictors of physical urban change , 2017, Proceedings of the National Academy of Sciences.

[29]  C. Norberg-Schulz Genius Loci: Towards a Phenomenology of Architecture , 1979 .

[30]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[31]  Vivek Kumar Singh,et al.  Towards Measuring Fine-Grained Diversity Using Social Media Photographs , 2017, ICWSM.

[32]  D. Ruths,et al.  Social media for large studies of behavior , 2014, Science.