Mind Your Crossings

For blind travelers, finding crosswalks and remaining within their borders while traversing them is a crucial part of any trip involving street crossings. While standard Orientation & Mobility (O&M) techniques allow blind travelers to safely negotiate street crossings, additional information about crosswalks and other important features at intersections would be helpful in many situations, resulting in greater safety and/or comfort during independent travel. For instance, in planning a trip a blind pedestrian may wish to be informed of the presence of all marked crossings near a desired route. We have conducted a survey of several O&M experts from the United States and Italy to determine the role that crosswalks play in travel by blind pedestrians. The results show stark differences between survey respondents from the U.S. compared with Italy: the former group emphasized the importance of following standard O&M techniques at all legal crossings (marked or unmarked), while the latter group strongly recommended crossing at marked crossings whenever possible. These contrasting opinions reflect differences in the traffic regulations of the two countries and highlight the diversity of needs that travelers in different regions may have. To address the challenges faced by blind pedestrians in negotiating street crossings, we devised a computer vision--based technique that mines existing spatial image databases for discovery of zebra crosswalks in urban settings. Our algorithm first searches for zebra crosswalks in satellite images; all candidates thus found are validated against spatially registered Google Street View images. This cascaded approach enables fast and reliable discovery and localization of zebra crosswalks in large image datasets. While fully automatic, our algorithm can be improved by a final crowdsourcing validation. To this end, we developed a Pedestrian Crossing Human Validation web service, which supports crowdsourcing, to rule out false positives and identify false negatives.

[1]  R. Welsh Foundations of Orientation and Mobility , 1979 .

[2]  Hironobu Takagi,et al.  NavCog: a navigational cognitive assistant for the blind , 2016, MobileHCI.

[3]  Pascal Neis,et al.  Assessing the Completeness of Bicycle Trail and Designated Lane Features in OpenStreetMap for the United States and Europe , 2013 .

[4]  Serge J. Belongie,et al.  Learning deep representations for ground-to-aerial geolocalization , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[6]  Rainer Stiefelhagen,et al.  Zebra Crossing Detection from Aerial Imagery Across Countries , 2016, ICCHP.

[7]  Giovanni Fusco,et al.  Self-Localization at Street Intersections , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[8]  Jon Froehlich,et al.  Improving public transit accessibility for blind riders by crowdsourcing bus stop landmark locations with Google street view , 2013, ASSETS.

[9]  Cem Ünsalan,et al.  Urban-Area and Building Detection Using SIFT Keypoints and Graph Theory , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Dragan Ahmetovic,et al.  Mind your crossings: Mining GIS imagery for crosswalk localization , 2016 .

[11]  James M. Coughlan,et al.  Smartphone-based crosswalk detection and localization for visually impaired pedestrians , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[12]  R L Knoblauch,et al.  MODEL PEDESTRIAN SAFETY PROGRAM USER'S GUIDE , 1987 .

[13]  C V Zegeer A proposed recommended practice: design and safety of pedestrian facilities , 1995 .

[14]  J B Kirschbaum,et al.  DESIGNING SIDEWALKS AND TRAILS FOR ACCESS, PART 2, BEST PRACTICES DESIGN GUIDE , 2001 .

[15]  Eric Horvitz,et al.  Incentives for truthful reporting in crowdsourcing , 2012, AAMAS.

[16]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[17]  Khai N. Truong,et al.  CrossingGuard: exploring information content in navigation aids for visually impaired pedestrians , 2012, CHI.

[18]  Ahmed M. Elgammal,et al.  Segmentation of occluded sidewalks in satellite images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[19]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[20]  Paul E. Ponchillia,et al.  Street crossing by sighted and blind pedestrians at a modern roundabout , 2005 .

[21]  Mehdi Mokhtarzade,et al.  Road detection from high-resolution satellite images using artificial neural networks , 2007, Int. J. Appl. Earth Obs. Geoinformation.

[22]  Sanja Fidler,et al.  Enhancing Road Maps by Parsing Aerial Images Around the World , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Stefano Mattoccia,et al.  Crosswalk Recognition Through Point-Cloud Processing and Deep-Learning Suited to a Wearable Mobility Aid for the Visually Impaired , 2015, ICIAP Workshops.

[24]  Roberto Manduchi,et al.  Zebra Crossing Spotter: Automatic Population of Spatial Databases for Increased Safety of Blind Travelers , 2015, ASSETS.

[25]  Dragan Ahmetovic,et al.  ZebraRecognizer: Pedestrian crossing recognition for people with visual impairment or blindness , 2016, Pattern Recognit..

[26]  Jon Froehlich,et al.  Combining crowdsourcing and google street view to identify street-level accessibility problems , 2013, CHI.

[27]  Jon Froehlich,et al.  Exploring Early Solutions for Automatically Identifying Inaccessible Sidewalks in the Physical World using Google Street View , 2014 .

[28]  Giovanni Fusco,et al.  Towards a Sign-Based Indoor Navigation System for People with Visual Impairments , 2016, ASSETS.

[29]  Uwe Stilla,et al.  Vehicle Detection in Very High Resolution Satellite Images of City Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Eric Horvitz,et al.  Combining human and machine intelligence in large-scale crowdsourcing , 2012, AAMAS.

[31]  Dragan Ahmetovic,et al.  ZebraRecognizer: Efficient and Precise Localization of Pedestrian Crossings , 2014, 2014 22nd International Conference on Pattern Recognition.

[32]  M. Goodchild Citizens as sensors: the world of volunteered geography , 2007 .

[33]  Dragan Ahmetovic,et al.  Zebralocalizer: identification and localization of pedestrian crossings , 2011, Mobile HCI.

[34]  Jianxiong Xiao,et al.  Multiple view semantic segmentation for street view images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[35]  Enrico Marzaduri Profili processualpenalistici della riforma del codice della strada , 1995 .

[36]  James M Coughlan,et al.  Crosswatch: a System for Providing Guidance to Visually Impaired Travelers at Traffic Intersections. , 2013, Journal of assistive technologies.

[37]  Hironobu Takagi,et al.  NavCog: turn-by-turn smartphone navigation assistant for people with visual impairments or blindness , 2016, W4A.

[38]  Jon Froehlich,et al.  Tohme: detecting curb ramps in google street view using crowdsourcing, computer vision, and machine learning , 2014, UIST.

[39]  Kay Fitzpatrick,et al.  Crosswalk Marking Field Visibility Study , 2010 .

[40]  Crowdsource Approach for Mapping of Illegal Dumps in the Czech Republic , 2013, Int. J. Spatial Data Infrastructures Res..

[41]  Giovanni Fusco,et al.  Determining a Blind Pedestrian's Location and Orientation at Traffic Intersections , 2014, ICCHP.

[42]  Alan Borning,et al.  Where's my bus stop?: supporting independence of blind transit riders with StopInfo , 2014, ASSETS.

[43]  Hironobu Takagi,et al.  Supporting Orientation of People with Visual Impairment: Analysis of Large Scale Usage Data , 2016, ASSETS.

[44]  Matthew T. Rice,et al.  Supporting Accessibility for Blind and Vision‐impaired People With a Localized Gazetteer and Open Source Geotechnology , 2012, Trans. GIS.

[45]  R L Knoblauch,et al.  MODEL PEDESTRIAN SAFETY PROGRAM USER'S GUIDE SUPPLEMENT. FINAL REPORT , 1987 .