Developing Sidewalk Inventory Data Using Street View Images

(1) Background: Public sidewalk GIS data are essential for smart city development. We developed an automated street-level sidewalk detection method with image-processing Google Street View data. (2) Methods: Street view images were processed to produce graph-based segmentations. Image segment regions were manually labeled and a random forest classifier was established. We used multiple aggregation steps to determine street-level sidewalk presence. (3) Results: In total, 2438 GSV street images and 78,255 segmented image regions were examined. The image-level sidewalk classifier had an 87% accuracy rate. The street-level sidewalk classifier performed with nearly 95% accuracy in most streets in the study area. (4) Conclusions: Highly accurate street-level sidewalk GIS data can be successfully developed using street view images.

[1]  Jon Froehlich,et al.  Characterizing and visualizing physical world accessibility at scale using crowdsourcing, computer vision, and machine learning , 2015, ASAC.

[2]  Ebony Carter,et al.  Enhancing pedestrian mobility in Smart Cities using Big Data , 2020 .

[3]  Paola Di Mascio,et al.  Managing sidewalk pavement maintenance: A case study to increase pedestrian safety , 2016 .

[4]  Farzad Rajaei Salmasi,et al.  A Hierarchical Smart Street Lighting System With Brute-Force Energy Optimization , 2017, IEEE Sensors Journal.

[5]  Massimo Marchiori.  Mind Your Step: Monitoring Pedestrian Sidewalks , 2018, 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[6]  Christian Früh,et al.  Google Street View: Capturing the World at Street Level , 2010, Computer.

[7]  Hong Yang,et al.  E-Scooter safety: The riding risk analysis based on mobile sensing data. , 2020, Accident; analysis and prevention.

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[10]  Mohamed Atef Elhamy Kamel,et al.  Encouraging walkability in GCC cities: smart urban solutions , 2013 .

[11]  Anne Vernez Moudon,et al.  Sidewalk Data in King County's Urban Growth Boundary , 2013 .

[12]  Geoff Boeing,et al.  OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networks , 2016, Comput. Environ. Urban Syst..

[13]  Zhenfeng Shao,et al.  ‘Big data’ for pedestrian volume: Exploring the use of Google Street View images for pedestrian counts , 2015 .

[14]  Giles Oatley,et al.  The Current and Future Role of Smart Street Furniture in Smart Cities , 2019, IEEE Communications Magazine.

[15]  Chao Chen,et al.  Using Random Forest to Learn Imbalanced Data , 2004 .

[16]  Xinyang Yu,et al.  BGVI: A New Index to Estimate Street-Side Greenery Using Baidu Street View Image , 2018, Forests.

[17]  Yichang Tsai,et al.  Automated Sidewalk Assessment Method for Americans with Disabilities Act Compliance Using Three-Dimensional Mobile Lidar , 2016 .

[18]  Philip M. Hurvitz,et al.  Split-Match-Aggregate (SMA) algorithm: integrating sidewalk data with transportation network data in GIS , 2015, Int. J. Geogr. Inf. Sci..

[19]  Stephen J Mooney,et al.  Development and deployment of the Computer Assisted Neighborhood Visual Assessment System (CANVAS) to measure health-related neighborhood conditions. , 2015, Health & place.

[20]  Nuno Sousa,et al.  Sidewalk Infrastructure Assessment Using a Multicriteria Methodology for Maintenance Planning , 2017 .

[21]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Julien O. Teitler,et al.  Using Google Street View to audit neighborhood environments. , 2011, American journal of preventive medicine.

[23]  Ankit Gupta,et al.  Assessing urban sidewalk networks based on three constructs: a synthesis of pedestrian level of service literature , 2020 .

[24]  智一 吉田,et al.  Efficient Graph-Based Image Segmentationを用いた圃場図自動作成手法の検討 , 2014 .

[25]  Luc Van Gool,et al.  3D all the way: Semantic segmentation of urban scenes from start to end in 3D , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Weixing Zhang,et al.  Urban Forestry & Urban Greening , 2015 .

[27]  Chengbo Ai,et al.  A network-level sidewalk inventory method using mobile LiDAR and deep learning , 2020 .