Fusion of Artificial Vision and GPS to Improve Blind Pedestrian Positioning

Orientation and mobility are tremendous problems for Blind people. Assistive technologies based on Global Positioning System (GPS) could provide them with a remarkable autonomy. Unfortunately, GPS accuracy, Geographical Information System (GIS) data and map-matching techniques are adapted to vehicle navigation only, and fail in assisting pedestrian navigation, especially for the Blind. In this paper, we designed an assistive device for the Blind based on adapted GIS, and fusion of GPS and vision based positioning. The proposed assistive device may improve user positioning, even in urban environment where GPS signals are degraded. The estimated position would then be compatible with assisted navigation for the Blind. Interestingly the vision module may also answer Blind needs by providing them with situational awareness (localizing objects of interest) along the path. Note that the solution proposed for positioning could also enhance autonomous robots or vehicles localization.

[1]  David J. Kriegman,et al.  Selecting promising landmarks , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[2]  Young Soo Suh,et al.  The pedestrian navigation system using vision and inertial sensors , 2009, 2009 ICCAS-SICE.

[3]  Christophe Jouffrais,et al.  Assistive device for the blind based on object recognition: an application to identify currency bills , 2009, Assets '09.

[4]  Chengyang Zhang,et al.  Map-matching for low-sampling-rate GPS trajectories , 2009, GIS.

[5]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[6]  Anke M. Brock,et al.  Méthodes et outils de conception participative avec des utilisateurs non-voyants , 2010, IHM.

[7]  H. Petrie,et al.  MOBIC: DESIGNING A TRAVEL AID FOR BLIND AND ELDERLY PEOPLE. , 1996 .

[8]  Roberta L. Klatzky,et al.  A Geographical Information System for a GPS Based Personal Guidance System , 1998, Int. J. Geogr. Inf. Sci..

[9]  Manfred Wieser,et al.  Navigation: Principles of Positioning and Guidance , 2003 .

[10]  Simon J Thorpe,et al.  SpikeNET: an event-driven simulation package for modelling large networks of spiking neurons , 2003, Network.

[11]  Wolfram Burgard,et al.  Using the CONDENSATION algorithm for robust, vision-based mobile robot localization , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  S. J. Thorpe,et al.  Reverse engineering of the visual system using networks of spiking neurons , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[13]  Roberta L. Klatzky,et al.  Personal guidance system for the visually impaired , 1994, ASSETS.

[14]  S. Ceranka,et al.  Application of particle filtering in navigation system for blind , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[15]  Abdelsalam Helal,et al.  Drishti: an integrated navigation system for visually impaired and disabled , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[16]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[17]  Christophe Jouffrais,et al.  Artificial Vision for the Blind: a Bio-Inspired Algorithm for Objects and Obstacles Detection , 2010, Int. J. Image Graph..

[18]  Bernard Oriola,et al.  Designing an assistive device for the blind based on object localization and augmented auditory reality , 2008, Assets '08.

[19]  Gert Jan Gelderblom,et al.  Inventory of Electronic Mobility Aids for Persons with Visual Impairments: A Literature Review , 2008 .

[20]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[21]  Christophe Jouffrais,et al.  Route selection algorithm for Blind pedestrian , 2010, ICCAS 2010.

[22]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Adam C. Winstanley,et al.  Spatial Characteristics of Walking Areas for Pedestrian Navigation , 2009, 2009 Third International Conference on Multimedia and Ubiquitous Engineering.

[24]  Bettina Pressl,et al.  ODILIA - A Mobility Concept for the Visually Impaired , 2008, ICCHP.

[25]  Rufin van Rullen,et al.  SpikeNet: real-time visual processing with one spike per neuron , 2004, Neurocomputing.

[26]  A. Kornhauser,et al.  An Introduction to Map Matching for Personal Navigation Assistants , 1998 .

[27]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .