Urban Street Contexts Classification Using Convolutional Neural Networks and Streets Imagery

The classification of streets on road networks has been focused on the vehicular transportational features of streets. Examples of street labels include arterials, major roads, minor roads and so forth based on their transportational use. City authorities on the other hand have been shifting to more wholistic planning of streets. The modern approach towards designing and planning streets is more inclusive of the street context, meaning the side use of a street combined with the transportational features of a street. Several city authorities are developing new classification schemes for street context that extends traditional classification methods to include the use of land on the sides of a street. In those classification schemes, streets are labeled for example as commercial throughway, residential neighborhood, park etc. This modern approach to urban planning have been adopted by major cities such as the city of San Francisco, the state of Florida and Pennsylvania among many others. Currently, the process of labeling streets according to their contexts is manual and hence is tedious and time consuming. It will require manual labor to regularly relabel streets as the city develops. In this paper, we propose an approach to deploy advancements in computer vision towards modern urban planning. We propose a framework for automatic classification of street contexts. Using labeled street imagery we train deep convolutional neural networks (CNN) to perform the classification of street context. We show that CNN models can perform well achieving accuracies in the 81% to 87% range. We test various CNN architectures and report on their performances.

[1]  Yin Wang,et al.  Stacked U-Nets with Multi-output for Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[2]  Jing Huang,et al.  DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Licia Capra,et al.  Urban Computing: Concepts, Methodologies, and Applications , 2014, TIST.

[5]  Shuhei Hikosaka,et al.  Building Detection from Satellite Imagery using Ensemble of Size-Specific Detectors , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  A. Pentland,et al.  Life in the network: The coming age of computational social science: Science , 2009 .

[7]  Ramesh Raskar,et al.  Streetscore -- Predicting the Perceived Safety of One Million Streetscapes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Fahad Alhasoun,et al.  City Scale Next Place Prediction from Sparse Data through Similar Strangers , 2017 .

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Marta C. González,et al.  Using Convolutional Networks and Satellite Imagery to Identify Patterns in Urban Environments at a Large Scale , 2017, KDD.

[12]  Yu-Chiang Frank Wang,et al.  Deep Aggregation Net for Land Cover Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[14]  Philipp Rode,et al.  Cities: investing in energy and resource efficiency , 2011 .

[15]  Danqing Zhang Social-enabled Urban Data Analytics , 2018 .

[16]  Wei Tu,et al.  Integrating Aerial and Street View Images for Urban Land Use Classification , 2018, Remote. Sens..

[17]  Emanuele Strano,et al.  Modeling urbanization patterns at a global scale with generative adversarial networks , 2017 .

[18]  Ramesh Raskar,et al.  Computer vision uncovers predictors of physical urban change , 2017, Proceedings of the National Academy of Sciences.

[19]  Alexey Shvets,et al.  Fully Convolutional Network for Automatic Road Extraction from Satellite Imagery , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[20]  Ming Wu,et al.  D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Kinga Kita,et al.  Google Street View image of a house predicts car accident risk of its resident , 2019, 1904.05270.

[22]  Shubhra Aich,et al.  Semantic Binary Segmentation Using Convolutional Networks without Decoders , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).