A vision-based system supports mapping services for visually impaired people in indoor environments

This paper describes and extensively evaluates a visual-based system that autonomously operators for both building a map and localization tasks. The proposed system is to assist mapping services to the visually impaired/blind people in small or mid-scale environments such as inside a building or campus of school, hospital. Toward this end, the proposed approaches solely rely on visual data thanks to a self-designed image acquisition system. On one hand, a robust visual odometry method is utilized to create a map of the environments. On the other hand, the proposed approaches utilize FAB-MAP algorithm that is maybe the most successful for learning places in the environments. Map building and learning places in an environment are processed in an off-line phase. Through a matching place procedure, online captured images are continuously positioned on the map. Furthermore, we utilize a Kalman Filter that combines the matching results of current observation and the estimation of robot states based on its kinematic model. We evaluate performances of the proposed system through experimental schemes. The results show that the constructed map coincides with ground truth, and matching image-to-map is high confidence. The evaluations also contain scenarios which the blind pupils move following Robot. The experimental results confirmed that proposed system feasibly navigating blind pupils in indoor environments.

[1]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[2]  Paul Newman,et al.  SLAM-Loop Closing with Visually Salient Features , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[3]  John Nicholson,et al.  RFID in robot-assisted indoor navigation for the visually impaired , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[4]  Thi-Thanh-Hai Tran,et al.  Mapping services in indoor environments based on image sequences , 2014, 2014 IEEE Fifth International Conference on Communications and Electronics (ICCE).

[5]  P. Alcantarilla Vision based localization: from humanoid robots to visually impaired people , 2011 .

[6]  Jack M. Loomis,et al.  GPS-Based Navigation Systems for the Visually Impaired , 2001 .

[7]  Serge J. Belongie,et al.  Toward real-time grocery detection for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[8]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[9]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[10]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[11]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  James M. Coughlan,et al.  Smartphone-based crosswalk detection and localization for visually impaired pedestrians , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[13]  Wilfried Philips,et al.  Robust Visual Odometry Using Uncertainty Models , 2011, ACIVS.

[14]  Gérard G. Medioni,et al.  Robot vision for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[15]  Abdelsalam Helal,et al.  Drishti: an integrated navigation system for visually impaired and disabled , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[16]  Jeffrey P. Bigham,et al.  VizWiz::LocateIt - enabling blind people to locate objects in their environment , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[17]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[18]  Jason J. Liu,et al.  Video-based localization without 3D mapping for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.