A mobile phone system to find crosswalks for visually impaired pedestrians.

Urban intersections are the most dangerous parts of a blind or visually impaired pedestrian's travel. A prerequisite for safely crossing an intersection is entering the crosswalk in the right direction and avoiding the danger of straying outside the crosswalk. This paper presents a proof of concept system that seeks to provide such alignment information. The system consists of a standard mobile phone with built-in camera that uses computer vision algorithms to detect any crosswalk visible in the camera's field of view; audio feedback from the phone then helps the user align him/herself to it. Our prototype implementation on a Nokia mobile phone runs in about one second per image, and is intended for eventual use in a mobile phone system that will aid blind and visually impaired pedestrians in navigating traffic intersections.

[1]  Roberto Manduchi,et al.  Cell Phone-based Wayfinding for the Visually Impaired , 2006 .

[2]  Michael Brady,et al.  Road feature detection and estimation , 2003, Machine Vision and Applications.

[3]  Stella X. Yu,et al.  Object-specific figure-ground segregation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[4]  James M. Coughlan,et al.  Grouping Using Factor Graphs: An Approach for Finding Text with a Camera Phone , 2007, GbRPR.

[5]  Roberto Manduchi,et al.  Functional Assessment of a Camera Phone-Based Wayfinding System Operated by Blind Users , 2007 .

[6]  James M. Coughlan,et al.  Crosswatch: A Camera Phone System for Orienting Visually Impaired Pedestrians at Traffic Intersections , 2008, ICCHP.

[7]  Shi,et al.  A Fast Algorithm for Finding Crosswalks using Figure-Ground Segmentation , 2006 .

[8]  S. Hook.  Lighthouse Handbook on Vision Impairment and Vision Rehabilitation , 2001 .

[9]  Martial Hebert,et al.  Man-made structure detection in natural images using a causal multiscale random field , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[10]  Sven Utcke.  Grouping based on projective geometry constraints and uncertainty , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[11]  Stephen Se.  Zebra-crossing detection for the partially sighted , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[12]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[13]  Mohammad Shorif Uddin,et al.  Bipolarity and Projective Invariant-Based Zebra-Crossing Detection for the Visually Impaired , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[14]  Janet M Barlow,et al.  Blind Pedestrians and the Changing Technology and Geometry of Signalized Intersections: Safety, Orientation, and Independence , 2005, Journal of visual impairment & blindness.

[15]  Janet M. Barlow,et al.  Locator Tones for Pedestrian Signals , 2000 .

[16]  J Brabyn,et al.  Remote infrared signage evaluation for transit stations and intersections. , 1999, Journal of rehabilitation research and development.

[17]  R L Klatzky,et al.  Navigating without vision: basic and applied research. , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[18]  Billie Louise Bentzen,et al.  New orientation and accessibility option for persons with visual impairment: transportation applications for remote infrared audible signage , 2001, Clinical & experimental optometry.

[19]  L. Williams,et al.  Contents , 2020, Ophthalmology (Rochester, Minn.).

[20]  James M. Coughlan,et al.  Detecting and locating crosswalks using a camera phone , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.