Classifying Street Spaces with Street View Images for a Spatial Indicator of Urban Functions

Streets, as one type of land use, are generally treated as developed or impervious areas in most of the land-use/land-cover studies. This coarse classification substantially understates the value of streets as a type of public space with the most complexity. Street space, being an important arena for urban vitality, is valued by various dimensions, such as transportation, recreation, aesthetics, public health, and social interactions. Traditional remote sensing approaches taking a sky viewpoint cannot capture these dimensions not only due to the resolution issue but also the lack of a citizen viewpoint. The proliferation of street view images provides an unprecedented opportunity to characterize street spaces from a citizen perspective at the human scale for an entire city. This paper aims to characterize and classify street spaces based on features extracted from street view images by a deep learning model of computer vision. A rule-based clustering method is devised to support the empirically generated classification of street spaces. The proposed classification scheme of street spaces can serve as an indirect indicator of place-related functions if not a direct one, once its relationship with urban functions is empirically tested and established. This approach is empirically applied to Beijing city to demonstrate its validity.

[1]  Yao Yao,et al.  Using deep learning to examine street view green and blue spaces and their associations with geriatric depression in Beijing, China , 2019, Environment international.

[2]  Donald Appleyard,et al.  Livable Streets: Protected Neighborhoods? , 1980 .

[3]  César A. Hidalgo,et al.  The Collaborative Image of The City: Mapping the Inequality of Urban Perception , 2013, PloS one.

[4]  Jan Gehl,et al.  Life Between Buildings: Using Public Space , 2003 .

[5]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Nicholas S. G. Williams,et al.  Drivers of diversity and tree cover in gardens, parks and streetscapes in an Australian city , 2012 .

[7]  Lun Wu,et al.  Social sensing from street-level imagery: A case study in learning spatio-temporal urban mobility patterns , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[8]  Ramesh Raskar,et al.  Deep Learning the City: Quantifying Urban Perception at a Global Scale , 2016, ECCV.

[9]  Paolo Santi,et al.  Investigating the association between streetscapes and human walking activities using Google Street View and human trajectory data , 2018, Trans. GIS.

[10]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Hui Lin,et al.  Framework for Virtual Cognitive Experiment in Virtual Geographic Environments , 2018, ISPRS Int. J. Geo Inf..

[12]  Yao Yao,et al.  Urban greenery and mental wellbeing in adults: Cross-sectional mediation analyses on multiple pathways across different greenery measures. , 2019, Environmental research.

[13]  J. Jacobs The Death and Life of Great American Cities , 1962 .

[14]  Ying Long,et al.  Measuring visual quality of street space and its temporal variation: Methodology and its application in the Hutong area in Beijing , 2019, Landscape and Urban Planning.

[15]  Weidong Li,et al.  Does the Visibility of Greenery Increase Perceived Safety in Urban Areas? Evidence from the Place Pulse 1.0 Dataset , 2015, ISPRS Int. J. Geo Inf..

[16]  Yi Lu,et al.  Measuring daily accessed street greenery: A human-scale approach for informing better urban planning practices , 2019, Landscape and Urban Planning.

[17]  Mark Stevenson,et al.  Streetscape augmentation using generative adversarial networks: insights related to health and wellbeing , 2019, Sustainable Cities and Society.

[18]  Lijing L. Yan,et al.  Residential greenness and mortality in oldest-old women and men in China: a longitudinal cohort study , 2019, The Lancet. Planetary health.

[19]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Hui Wang,et al.  A machine learning-based method for the large-scale evaluation of the qualities of the urban environment , 2017, Comput. Environ. Urban Syst..

[21]  De Wang,et al.  Daily Accessed Street Greenery and Housing Price: Measuring Economic Performance of Human-Scale Streetscapes via New Urban Data , 2019, Sustainability.

[22]  B. Jiang Head/Tail Breaks: A New Classification Scheme for Data with a Heavy-Tailed Distribution , 2012, 1209.2801.

[23]  Clare Cooper Marcus DESIGN IN FAMILIAR PLACES: WHAT MAKES HOME ENVIRONMENTS LOOK GOOD , 1989, Landscape Journal.

[24]  Weixing Zhang,et al.  Urban Forestry & Urban Greening , 2015 .

[25]  Hui Lin,et al.  Representing place locales using scene elements , 2018, Comput. Environ. Urban Syst..

[26]  Bolei Zhou,et al.  Landscape and Urban Planning , 2018 .

[27]  R. Leemans Changes in Land use and land cover: A global perspective , 1995 .

[28]  Yan Song,et al.  Comparing measures of urban land use mix , 2013, Comput. Environ. Urban Syst..

[29]  Lisa Aultman-Hall,et al.  Streetscape skeleton measurement and classification , 2017 .

[30]  Nadine Eberhardt Measuring Urban Design Metrics For Livable Places , 2016 .

[31]  Michael Luca,et al.  Big Data and Big Cities: The Promises and Limitations of Improved Measures of Urban Life , 2015 .

[32]  Barbara McCann,et al.  Complete the Streets , 2005 .

[33]  Weidong Li,et al.  Building block level urban land-use information retrieval based on Google Street View images , 2017 .

[34]  Michael Brauer,et al.  A picture tells a thousand … exposures: Opportunities and challenges of deep learning image analyses in exposure science and environmental epidemiology , 2018, Environment international.

[35]  Ramesh Raskar,et al.  Computer vision uncovers predictors of physical urban change , 2017, Proceedings of the National Academy of Sciences.

[36]  Ying Long,et al.  How green are the streets? An analysis for central areas of Chinese cities using Tencent Street View , 2017, PloS one.