An indoor navigation aid for the visually impaired

This paper presents a 6-DOF pose estimation (PE) method and an indoor wayfinding system based on the method for the visually impaired (VI). The PE method involves two graph SLAM processes to reduce the accumulative pose error of device. In the first step, the floor plane is extracted from the 3D camera's point cloud and added as a landmark node into the graph for 6-DOF SLAM to reduce roll, pitch and Z errors. In the second step, the wall lines are extracted and incorporated into the graph for 3-DOF SLAM to reduce X, Y and yaw errors. The method reduces the 6-DOF pose error and results in more accurate pose with less computational time than the existing state-of-the-art planar SLAM methods. Based on the PE method, a wayfinding system is developed for navigating a VI person in an indoor environment. The system uses the estimated pose and floorplan to locate the device user in a building and guide the user by announcing the points of interest and navigational commands through a speech interface. Experimental results validate the effectiveness of the PE method and demonstrate that the system may substantially ease an indoor navigation task.

[1]  Cang Ye Navigating a Portable Robotic Device by a 3D imaging sensor , 2010, 2010 IEEE Sensors.

[2]  Arthur Gerard DeVoe,et al.  Estimated Statistics on Blindness and Vision Problems. , 1967 .

[3]  Henrik I. Christensen,et al.  Planar surface SLAM with 3D and 2D sensors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  Amirhossein Tamjidi,et al.  6-DOF Pose Estimation of a Robotic Navigation Aid by Tracking Visual and Geometric Features , 2015, IEEE Transactions on Automation Science and Engineering.

[6]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Cang Ye,et al.  A visual odometry method based on the SwissRanger SR4000 , 2010, Defense + Commercial Sensing.

[9]  Amirhossein Tamjidi,et al.  6-DOF pose estimation of a Portable Navigation Aid for the visually impaired , 2013, 2013 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[10]  Gérard G. Medioni,et al.  Robot vision for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[11]  Kurt Konolige,et al.  Visual Odometry Using Sparse Bundle Adjustment on an Autonomous Outdoor Vehicle , 2006, AMS.

[12]  Javier Civera,et al.  1‐Point RANSAC for extended Kalman filtering: Application to real‐time structure from motion and visual odometry , 2010, J. Field Robotics.

[13]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[14]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[15]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[16]  G. Medioni,et al.  RGB-D camera Based Navigation for the Visually Impaired , 2011 .

[17]  Roland Siegwart,et al.  3D SLAM using planar segments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Juan Manuel Sáez,et al.  First Steps towards Stereo-based 6DOF SLAM for the Visually Impaired , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[19]  Wolfram Burgard,et al.  An evaluation of the RGB-D SLAM system , 2012, 2012 IEEE International Conference on Robotics and Automation.

[20]  Frank Dellaert,et al.  Incremental smoothing and mapping , 2008 .

[21]  Yakup Genc,et al.  GPU-based Video Feature Tracking And Matching , 2006 .

[22]  P. Ptasinski,et al.  A GPS based navigation aid for the blind , 2003, 17th International Conference on Applied Electromagnetics and Communications, 2003. ICECom 2003..

[23]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Joel A. Hesch,et al.  Design and Analysis of a Portable Indoor Localization Aid for the Visually Impaired , 2010, Int. J. Robotics Res..

[25]  C. Ye,et al.  NCC-RANSAC: A fast plane extraction method for navigating a smart cane for the visually impaired , 2013, 2013 IEEE International Conference on Automation Science and Engineering (CASE).

[26]  John Nicholson,et al.  Robot-assisted wayfinding for the visually impaired in structured indoor environments , 2006, Auton. Robots.

[27]  Jan-Michael Frahm,et al.  Exploring High-Level Plane Primitives for Indoor 3D Reconstruction with a Hand-held RGB-D Camera , 2012, ACCV Workshops.

[28]  Cang Ye Mixed pixels removal of a Laser Rangefinder for mobile robot 3-D terrain mapping , 2008, 2008 International Conference on Information and Automation.