An Intuitive Mobility Aid for Visually Impaired People Based on Stereo Vision

We present a wearable assistance system for visually impaired persons that perceives the environment with a stereo camera and communicates obstacles and other objects to the user. We develop our idea of combining perception on an increased level of scene understanding with acoustic feedback to obtain an intuitive mobility aid. We describe our core techniques of scene modelling, object tracking, and acoustic feedback and show in an experimental study how our system can help improving the mobility and safety of visually impaired users.

[1]  Luc Van Gool,et al.  Moving obstacle detection in highly dynamic scenes , 2009, 2009 IEEE International Conference on Robotics and Automation.

[2]  E. Kraft,et al.  A quaternion-based unscented Kalman filter for orientation tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[3]  Clemens Rabe,et al.  STEREO VISION-BASED DETECTION OF MOVING OBJECTS UNDER STRONG CAMERA MOTION , 2016, VISAPP 2016.

[4]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[5]  J.L. Gonzalez-Mora,et al.  Seeing the world by hearing: Virtual Acoustic Space (VAS) a new space perception system for blind people. , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[6]  Martin Lauer,et al.  Robust ground plane tracking in cluttered environments from egocentric stereo vision , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Andrea Fusiello,et al.  Segmentation and tracking of multiple video objects , 2007, Pattern Recognit..

[8]  Gérard G. Medioni,et al.  Robot vision for the visually impaired , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[9]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[10]  Shraga Shoval,et al.  NavBelt and the Guide-Cane [obstacle-avoidance systems for the blind and visually impaired] , 2003, IEEE Robotics Autom. Mag..

[11]  L. Kay.  An ultrasonic sensing probe as a mobility aid for the blind , 1964 .

[12]  Yiannos Manoli,et al.  Stochastic cloning Kalman filter for visual odometry and inertial/magnetic data fusion , 2013, Proceedings of the 16th International Conference on Information Fusion.

[13]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[15]  G. Lepage.  [The voice]. , 1954, Revue medicale de Liege.

[16]  David W. Murray,et al.  On the Choice and Placement of Wearable Vision Sensors , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[18]  Davide Rocchesso,et al.  The Sonification Handbook , 2011 .

[19]  Martin Lauer,et al.  Geometry Estimation of Urban Street Canyons Using Stereo Vision from Egocentric View , 2015 .

[20]  Stergios I. Roumeliotis,et al.  Stochastic cloning: a generalized framework for processing relative state measurements , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).