Feasibility of interactive localization and navigation of people with visual impairments

Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation o f the physical space or expensive sensors. Thus, few systems have been adopted. Th is work conducts a feasibility study of whether it is possible to localize and guide people with VI using inexpensive sensors, such as compasses and pedometers, which are available in portable devices like smart phones. The proposed approach takes advantage of interaction between the system and the human user, who confirms the presence of landmarks. Experiments are employed to study what kind of direc tions are successful in assisting human users to reach their destination. These experiments show that Bayesian localization tools provide sufficient accura y, while achieving realtime operation, despite the minimalistic, noisy nature of sens ors and the limited computational resources available on smart phones.

[1]  Seth J. Teller,et al.  Wide-Area Egomotion Estimation from Known 3D Structure , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Avi Parush,et al.  Landmarks for navigators who are visually impaired , 2005 .

[3]  Frank Dellaert,et al.  A Multi-Camera Pose Tracker for Assisting the Visually Impaired , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[4]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[5]  Joel A. Hesch,et al.  A 3D pose estimator for the visually impaired , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Abdelsalam Helal,et al.  Drishti: an integrated indoor/outdoor blind navigation system and service , 2004, Second IEEE Annual Conference on Pervasive Computing and Communications, 2004. Proceedings of the.

[7]  A. Rosenfeld,et al.  IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS , 2022 .

[8]  Ken Sakamura,et al.  Assisting mobility of the disabled using space-identifying ubiquitous infrastructure , 2008, Assets '08.

[9]  Peter C. Cheeseman,et al.  Estimating uncertain spatial relationships in robotics , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[10]  Thomas Ertl,et al.  Design and development of an indoor navigation and object identification system for the blind , 2004, ACM SIGACCESS Access. Comput..

[11]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[12]  Michitaka Hirose,et al.  Colorplate: Virtual Leading Blocks for the Deaf-Blind: A Real-Time Way-Finder by Verbal-Nonverbal Hybrid Interface and High-Density RFID Tag Space , 2004, VR.

[13]  T. H. Riehle,et al.  An indoor navigation system to support the visually impaired , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[14]  Roberto Manduchi,et al.  Dynamic environment exploration using a virtual white cane , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Ph. van Dorp,et al.  Real-time human walking estimation with radar , 2003 .

[16]  Shraga Shoval,et al.  Auditory guidance with the Navbelt-a computerized travel aid for the blind , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[17]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[18]  Manuela M. Veloso,et al.  Sensor resetting localization for poorly modelled mobile robots , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[19]  Kostas E. Bekris,et al.  On the feasibility of using wireless ethernet for indoor localization , 2004, IEEE Transactions on Robotics and Automation.

[20]  Frank Dellaert,et al.  Map-based priors for localization , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[21]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[22]  Gordon E Legge,et al.  Learning Building Layouts with Non-Geometric Visual Information: The Effects of Visual Impairment and Age , 2008, Perception.

[23]  Abdelsalam Helal,et al.  RFID information grid for blind navigation and wayfinding , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[24]  Gordon E. Legge,et al.  Digital Sign System for Indoor Wayfinding for the Visually Impaired , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[25]  David A. Ross,et al.  Development of a Wearable Computer Orientation System , 2002, Personal and Ubiquitous Computing.

[26]  Gustavo Arechavaleta Servin.  An optimality principle governing human walking , 2007 .

[27]  John Nicholson,et al.  RFID in robot-assisted indoor navigation for the visually impaired , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[28]  Kostas E. Bekris,et al.  Robotics-Based Location Sensing Using Wireless Ethernet , 2005, Wirel. Networks.

[29]  Roberta L. Klatzky,et al.  Auditory Display Modes and Guidance , 1998 .

[30]  Joel A. Hesch,et al.  An Indoor Localization Aid for the Visually Impaired , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[31]  Angelo M. Sabatini,et al.  A step toward GPS/INS personal navigation systems: real-time assessment of gait by foot inertial sensing , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.