Large-Scale Street Space Quality Evaluation Based on Deep Learning Over Street View Image

In the quantitative study of cities, the extraction and appropriate evaluation of the space quality information of urban streets can provide great insight and guidance to urban planners to build more livable urban public space, which is also of great significance for urban management. However, the traditional methods, which mostly use the manual statistical investigation to carry on, are difficult to carry out large-scale objective quantification. To tackle this challenge, this paper presents a complete quantitative analysis method for street space quality score based on street view image analysis. Three quantitative indices (i.e. cleanliness, comfort and traffic) for the evaluation of street space qualities are employed in this study as suggested in literature on urban planning. A new deep learning approach, named as Cross-connected CNN + SVR, is proposed to estimate the street space quality score. A new dataset is constructed based on Baidu Street View image for the training and validation of the proposed framework. Experimental results suggested that the three indices used in this paper is able to reflect the street’s objective visual attributes effectively and the proposed CNN + SVR approach has produced insightful results. The proposed approach has been applied to evaluate the street space quality score of the 2nd ring road district of Chengdu, to demonstrate the value and effectiveness of the proposed work for providing data support and analytics support to urban planners.

[1]  Peter H. N. de With,et al.  Exploiting street-level panoramic images for large-scale automated surveying of traffic signs , 2014, Machine Vision and Applications.

[2]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ramesh Raskar,et al.  Computer vision uncovers predictors of physical urban change , 2017, Proceedings of the National Academy of Sciences.

[4]  T. Daniel Whither scenic beauty? Visual landscape quality assessment in the 21st century , 2001 .

[5]  Marc Antrop,et al.  Background concepts for integrated landscape analysis. , 2000 .

[6]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Reid Ewing,et al.  Measuring Urban Design: Metrics for Livable Places , 2013 .

[9]  Zhang Yun Study of Street Space Perception in Shanghai Based on Semantic Differential Method , 2011 .

[10]  Chuanrong Zhang,et al.  Environmental inequities in terms of different types of urban greenery in Hartford, Connecticut , 2016 .

[11]  Ramesh Raskar,et al.  Deep Learning the City: Quantifying Urban Perception at a Global Scale , 2016, ECCV.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[14]  Wei Zeng,et al.  Human-scale Quality on Streets: A Large-scale and Efficient Analytical Approach Based on Street View Images and New Urban Analytical Tools , 2019, Urban Planning International.

[15]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Weixing Zhang,et al.  Urban Forestry & Urban Greening , 2015 .

[17]  Hui Wang,et al.  A machine learning-based method for the large-scale evaluation of the qualities of the urban environment , 2017, Comput. Environ. Urban Syst..

[18]  Hui Wang,et al.  A machine learning method for the large-scale evaluation of urban visual environment , 2016, ArXiv.

[19]  Lorenzo Porzi,et al.  Predicting and Understanding Urban Perception with Convolutional Neural Networks , 2015, ACM Multimedia.