RGB-D camera Based Navigation for the Visually Impaired

We present a wearable RGB-D camera based navigation system for the visually impaired. The navigation system is expected to enable the visually impaired to extend the ran ge of their activities compared to that provided by conventional aid devices, such as white cane. Since this design is a succes sor version of a previous stereo camera based system to overcome a limitation of stereo vision based systems, algorithmic str ucture of the system is maintained. In order to extract orientational information of the blind users, we incorporate visual odometry and feature based metric-topological (Simultaneous Local ization And Mapping) SLAM into our system. We build a vicinity map based on dense 3D data obtained from RGB-D camera, and perform path planning to provide the visually impaired with 3D traversability on the map. The 3D traversability analysis helps subjects steer away from obstacles in the path. A vesttype interface consisting of four microvibration motors delivers queues for real-time navigation with obstacle avoidance. Our syst em operates at12− 15Hz, and helps the visually impaired improve the mobility performance in a cluttered environment. The results show that navigation performance in indoor environments wi th the proposed lightweight and affordable RGB-D camera improves compared to a stereo-vision based system.

[1]  Andreas Nüchter,et al.  GPU-Accelerated Nearest Neighbor Search for 3D Registration , 2009, ICVS.

[2]  Gérard G. Medioni,et al.  Visual loop closing using multi-resolution SIFT grids in metric-topological SLAM , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Kurt Konolige,et al.  Visual Odometry Using Sparse Bundle Adjustment on an Autonomous Outdoor Vehicle , 2006, AMS.

[4]  Wolfram Burgard,et al.  Multi-Level Surface Maps for Outdoor Terrain Mapping and Loop Closing , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[6]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Roberto Manduchi,et al.  Dynamic environment exploration using a virtual white cane , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Sven Koenig,et al.  Fast replanning for navigation in unknown terrain , 2005, IEEE Transactions on Robotics.

[9]  Sebastian Thrun,et al.  FastSLAM 2.0: An Improved Particle Filtering Algorithm for Simultaneous Localization and Mapping that Provably Converges , 2003, IJCAI.

[10]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[11]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[12]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[13]  James R. Marston,et al.  Attitudes of Visually Impaired Persons toward the Use of Public Transportation , 1997 .

[14]  Iwan Ulrich,et al.  The GuideCane-a computerized travel aid for the active guidance of blind pedestrians , 1997, Proceedings of International Conference on Robotics and Automation.

[15]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[16]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Gérard G. Medioni,et al.  Robot vision for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[19]  Bitjoka Laurent,et al.  A sonar system modeled after spatial hearing and echolocating bats for blind mobility aid , 2007 .