Extracting and understanding urban areas of interest using geotagged photos

Abstract Urban areas of interest (AOI) refer to the regions within an urban environment that attract people's attention. Such areas often have high exposure to the general public, and receive a large number of visits. As a result, urban AOI can reveal useful information for city planners, transportation analysts, and location-based service providers to plan new business, extend existing infrastructure, and so forth. Urban AOI exist in people's perception and are defined by behaviors. However, such perception was rarely captured until the Social Web information technology revolution. Social media data record the interactions between users and their surrounding environment, and thus have the potential to uncover interesting urban areas and their underlying spatiotemporal dynamics. This paper presents a coherent framework for extracting and understanding urban AOI based on geotagged photos. Six different cities from six different countries have been selected for this study, and Flickr photo data covering these cities in the past ten years (2004–2014) have been retrieved. We identify AOI using DBSCAN clustering algorithm, understand AOI by extracting distinctive textual tags and preferable photos, and discuss the spatiotemporal dynamics as well as some insights derived from the AOI. An interactive prototype has also been implemented as a proof-of-concept. While Flickr data have been used in this study, the presented framework can also be applied to other geotagged photos.

[1]  Antony Galton,et al.  Efficient generation of simple polygons for characterizing the shape of a set of points in the plane , 2008, Pattern Recognit..

[2]  Michael F. Goodchild,et al.  Constructing places from spatial footprints , 2012, GEOCROWD '12.

[3]  Krzysztof Janowicz,et al.  A Thematic Approach to User Similarity Built on Geosocial Check-ins , 2013, AGILE Conf..

[4]  Stephan Winter,et al.  Enriching Wayfinding Instructions with Local Landmarks , 2002, GIScience.

[5]  Birgit Elias,et al.  Extracting Landmarks with Data Mining Methods , 2003, COSIT.

[6]  F. Monclús,et al.  Modernization and urban beautification: The 1888 Barcelona world's fair* , 1991 .

[7]  Lukas Furst Cities And Complexity Understanding Cities With Cellular Automata Agent Based Models And Fractals , 2016 .

[8]  Peter F. Fisher,et al.  Extending the applicability of viewsheds in landscape planning , 1996 .

[9]  Wei Song,et al.  Object-based spatial cluster analysis of urban landscape pattern using nighttime light satellite images: a case study of China , 2014, Int. J. Geogr. Inf. Sci..

[10]  Mor Naaman,et al.  World explorer: visualizing aggregate data from unstructured text in geo-referenced collections , 2007, JCDL '07.

[11]  Ross Purves,et al.  Exploring place through user-generated content: Using Flickr tags to describe city cores , 2010, J. Spatial Inf. Sci..

[12]  Wenwen Li,et al.  NMMI: A Mass Compactness Measure for Spatial Pattern Analysis of Areal Features , 2014 .

[13]  SaltonGerard,et al.  Term-weighting approaches in automatic text retrieval , 1988 .

[14]  Jianping Wu,et al.  Automated derivation of urban building density information using airborne LiDAR data and object-based method , 2010 .

[15]  Michael F. Goodchild,et al.  Where's Downtown?: Behavioral Methods for Determining Referents of Vague Spatial Queries , 2003 .

[16]  Martin Raubal,et al.  Extracting Dynamic Urban Mobility Patterns from Mobile Phone Data , 2012, GIScience.

[17]  Mor Naaman,et al.  How flickr helps us make sense of the world: context and content in community-contributed media collections , 2007, ACM Multimedia.

[18]  Clare Davies,et al.  User Needs and Implications for Modelling Vague Named Places , 2009, Spatial Cogn. Comput..

[19]  Anthony G. Cohn,et al.  The ‘Egg-Yolk’ Representation of Regions with Indeterminate Boundaries , 2020 .

[20]  Mor Naaman,et al.  Generating summaries and visualization for large collections of geo-referenced photographs , 2006, MIR '06.

[21]  Carsten Keßler,et al.  Bottom-Up Gazetteers: Learning from the Implicit Semantics of Geotags , 2009, GeoS.

[22]  Ray R. Larson,et al.  A comparison of geometric approaches to assessing spatial similarity for GIR , 2008, Int. J. Geogr. Inf. Sci..

[23]  Mor Naaman,et al.  Methods for extracting place semantics from Flickr tags , 2009, TWEB.

[24]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Hans-Peter Kriegel,et al.  Measuring the Complexity of Polygonal Objects , 1995, ACM-GIS.

[26]  M. Goodchild,et al.  Crowdsourcing Geographic Knowledge: Volunteered Geographic Information (VGI) in Theory and Practice , 2012 .

[27]  Ray A. Jarvis,et al.  On the Identification of the Convex Hull of a Finite Set of Points in the Plane , 1973, Inf. Process. Lett..

[28]  Norman M. Sadeh,et al.  The Livehoods Project: Utilizing Social Media to Understand the Dynamics of a City , 2012, ICWSM.

[29]  Natasha Gelfand,et al.  Visual summaries of popular landmarks from community photo collections , 2009 .

[30]  Jianping Wu,et al.  A multistage collaborative 3D GIS to support public participation , 2013, Int. J. Digit. Earth.

[31]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[32]  Prostitution In Nevada,et al.  ANNALS of the Association of American Geographers , 1974 .

[33]  Krzysztof Janowicz,et al.  POI Pulse: A Multi-granular, Semantic Signature–Based Information Observatory for the Interactive Visualization of Big Geosocial Data , 2015, Cartogr. Int. J. Geogr. Inf. Geovisualization.

[34]  S. Elwood Volunteered geographic information: future research directions motivated by critical, participatory, and feminist GIS , 2008 .

[35]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[36]  Hideo Joho,et al.  Spatially-Aware Information Retrieval on the Internet , 2022 .

[37]  Venkatesh Raghavan,et al.  Development of track log and point of interest management system using Free and Open Source Software , 2010 .

[38]  Patrick Weber,et al.  OpenStreetMap: User-Generated Street Maps , 2008, IEEE Pervasive Computing.

[39]  Jianping Wu,et al.  Evaluating the Ability of NPP-VIIRS Nighttime Light Data to Estimate the Gross Domestic Product and the Electric Power Consumption of China at Multiple Scales: A Comparison with DMSP-OLS Data , 2014, Remote. Sens..

[40]  Jennifer E. Rowley,et al.  The wisdom hierarchy: representations of the DIKW hierarchy , 2007, J. Inf. Sci..

[41]  Kyumin Lee,et al.  Exploring Millions of Footprints in Location Sharing Services , 2011, ICWSM.

[42]  Tat-Seng Chua,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, CVPR.

[43]  Gerard Salton,et al.  Term-Weighting Approaches in Automatic Text Retrieval , 1988, Inf. Process. Manag..

[44]  W. Chou,et al.  Social Media Use in the United States: Implications for Health Communication , 2009, Journal of medical Internet research.

[45]  Slava Kisilevich,et al.  Discovering Landmark Preferences and Movement Patterns from Photo Postings , 2010, Trans. GIS.

[46]  Christoph F. Eick,et al.  Creating Polygon Models for Spatial Clusters , 2014, ISMIS.

[47]  Yasunari Matsuno,et al.  Exploring and estimating in-use steel stocks in civil engineering and buildings from night-time lights , 2013 .

[48]  Yang Song,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  Qi Tian,et al.  Mining flickr landmarks by modeling reconstruction sparsity , 2011, TOMCCAP.

[50]  M. Haklay How Good is Volunteered Geographical Information? A Comparative Study of OpenStreetMap and Ordnance Survey Datasets , 2010 .

[51]  Michael Batty,et al.  Cities and complexity - understanding cities with cellular automata, agent-based models, and fractals , 2007 .

[52]  Wenwen Li,et al.  Constructing gazetteers from volunteered Big Geo-Data based on Hadoop , 2013, Comput. Environ. Urban Syst..

[53]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[54]  Slava Kisilevich,et al.  Where Would You Go on Your Next Vacation? A Framework for Visual Exploration of Attractive Places , 2010, 2010 Second International Conference on Advanced Geographic Information Systems, Applications, and Services.

[55]  Yu Liu,et al.  A point-set-based approximation for areal objects: A case study of representing localities , 2010, Comput. Environ. Urban Syst..

[56]  M. Goodchild Citizens as sensors: the world of volunteered geography , 2007 .

[57]  Matthew Gandy,et al.  Urban nature and the ecological imaginary , 2006, The Routledge Companion to Urban Imaginaries.

[58]  Hansi Senaratne,et al.  Using Reverse Viewshed Analysis to Assess the Location Correctness of Visually Generated VGI , 2013, Trans. GIS.

[59]  Slava Kisilevich,et al.  P-DBSCAN: a density based clustering algorithm for exploration and analysis of attractive areas using collections of geo-tagged photos , 2010, COM.Geo '10.

[60]  M. Goodchild Prospects for a Space–Time GIS , 2013 .

[61]  Kristina Lerman,et al.  Learning boundaries of vague places from noisy annotations , 2011, GIS.