Using Technology Developed for Autonomous Cars to Help Navigate Blind People

Autonomous driving is currently a very active research area with virtually all automotive manufacturers competing to bring the first autonomous car to the market. This race leads to billions of dollars being invested in the development of novel sensors, processing platforms, and algorithms. In this paper, we explore the synergies between the challenges in self-driving technology and development of navigation aids for blind people. We aim to leverage the recently emerged methods for self-driving cars, and use it to develop assistive technology for the visually impaired. In particular we focus on the task of perceiving the environment in realtime from cameras. First, we review current developments in embedded platforms for real-time computation as well as current algorithms for image processing, obstacle segmentation and classification. Then, as a proof-of-concept, we build an obstacle avoidance system for blind people that is based on a hardware platform used in the automotive industry. To perceive the environment, we adapt an implementation of the stixels algorithm, designed for self-driving cars. We discuss the challenges and modifications required for such an application domain transfer. Finally, to show its usability in practice, we conduct and evaluate a user study with six blindfolded people.

[1]  David Vázquez,et al.  GPU-Accelerated Real-Time Stixel Computation , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[2]  25 Blind Navigation and the Role of Technology , 2008 .

[3]  Sepp Hochreiter,et al.  Speeding up Semantic Segmentation for Autonomous Driving , 2016 .

[4]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[5]  H. Fernandes,et al.  Stereo vision in blind navigation assistance , 2010, 2010 World Automation Congress.

[6]  David Gregg,et al.  The Movidius Myriad Architecture's Potential for Scientific Computing , 2015, IEEE Micro.

[7]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  John Nicholson,et al.  RFID in robot-assisted indoor navigation for the visually impaired , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Martin Lauer,et al.  An Intuitive Mobility Aid for Visually Impaired People Based on Stereo Vision , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[10]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[11]  Jinxiang Wang,et al.  Efficient Moving Objects Detection by Lidar for Rain Removal , 2016, ICIC.

[12]  Rainer Stiefelhagen,et al.  Cognitive Evaluation of Haptic and Audio Feedback in Short Range Navigation Tasks , 2014, ICCHP.

[13]  Qiang Wang,et al.  Benchmarking State-of-the-Art Deep Learning Software Tools , 2016, 2016 7th International Conference on Cloud Computing and Big Data (CCBD).

[14]  Marc Pollefeys,et al.  Semantic Stixels: Depth is not enough , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[15]  Lilit Hakobyan,et al.  Mobile assistive technologies for the visually impaired. , 2013, Survey of ophthalmology.

[16]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[17]  Andrei Bursuc,et al.  A Smartphone-Based Obstacle Detection and Classification System for Assisting Visually Impaired People , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[18]  Antonio M. López,et al.  Embedded Real-time Stereo Estimation via Semi-Global Matching on the GPU , 2016, ICCS.

[19]  Kumar Yelamarthi,et al.  RFID and GPS integrated navigation system for the visually impaired , 2010, 2010 53rd IEEE International Midwest Symposium on Circuits and Systems.

[20]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[21]  Gérard G. Medioni,et al.  Visual Navigation Aid for the Blind in Dynamic Environments , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.