Negative obstacle detection for wearable assistive devices for visually impaired

The research on developing assistive devices for visually impaired people greatly relies on image processing techniques. Extensive effort is made on detecting the obstacles in front of the user. Beside the normal obstacles that the user can bump into, another category of obstacles, negative obstacles must also be detected. Negative obstacles are usually represented by holes in the ground or regions that lay bellow the ground surface. Such obstacles represent a potential danger to the visually impaired user and could lead to serious injury if not detected. In this paper, we introduce a stereo vision system to identify and track negative obstacles located in front of the user. The identification is performed in the disparity image based on an estimation of the ground surface in the stereo images. The tracking relies on a camera motion estimation approach. The algorithm we introduce in this paper was integrated and tested with a wearable assistive device to prove its efficiency. We evaluate the accuracy of our solution using various real-life scenarios.

[1]  Ling Li,et al.  A Smartphone-Based Obstacle Sensor for the Visually Impaired , 2010, UIC.

[2]  Adrian Burlacu,et al.  Obstacle detection in stereo sequences using multiple representations of the disparity map , 2016, 2016 20th International Conference on System Theory, Control and Computing (ICSTCC).

[3]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[4]  Wei Sun,et al.  Obstacle Detection System for Visually Impaired People Based on Stereo Vision , 2010, 2010 Fourth International Conference on Genetic and Evolutionary Computing.

[5]  Juan Manuel Saez Martinez,et al.  Stereo-based Aerial Obstacle Detection for the Visually Impaired , 2008 .

[6]  Adrian Burlacu,et al.  Robust ground plane detection and tracking in stereo sequences using camera orientation , 2016, 2016 20th International Conference on System Theory, Control and Computing (ICSTCC).

[7]  Sazali Yaacob,et al.  Fuzzy-Rule-Based Object Identification Methodology for NAVI System , 2005, EURASIP J. Adv. Signal Process..

[8]  Andreas Geiger,et al.  Efficient Large-Scale Stereo Matching , 2010, ACCV.

[9]  M. Faruque,et al.  ELECTRONIC TRAVEL AID FOR THE BLIND , 2001 .

[10]  Zhengyou Zhang,et al.  Auditory augmented reality: Object sonification for the visually impaired , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[11]  Juan Manuel Sáez,et al.  Aerial Obstacle Detection With 3-D Mobile Devices , 2015, IEEE Journal of Biomedical and Health Informatics.

[12]  Jun Zhao,et al.  Detection of non-flat ground surfaces using V-Disparity images , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Dai Yiruo,et al.  Complex ground plane detection based on V-disparity map in off-road environment , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[14]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[15]  Stefano Mattoccia,et al.  3D Glasses as Mobility Aid for Visually Impaired People , 2014, ECCV Workshops.

[16]  Benjamin Kuipers,et al.  Detecting obstacles and drop-offs using stereo and motion cues for safe local motion , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Sazali Yaacob,et al.  A Stereo Image Processing System for Visually Impaired , 2008 .

[18]  Benjamin Kuipers,et al.  A stereo vision based mapping algorithm for detecting inclines, drop-offs, and obstacles for safe local navigation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  J. M. Hans du Buf,et al.  The SmartVision local navigation aid for blind and visually impaired persons , 2011 .

[20]  L. M. Bergasa,et al.  Obstacle Avoidance System for Ass isting Visually Impaired People , 2012 .

[21]  James M. Coughlan,et al.  Terrain Analysis for Blind Wheelchair Users: Computer Vision Algorithms for Finding Curbs and other Negative Obstacles , 2007, CVHI.

[22]  Payman Moallem,et al.  A robust negative obstacle detection method using seed-growing and dynamic programming for visually-impaired/blind persons , 2011 .

[23]  Andrei Bursuc,et al.  A Smartphone-Based Obstacle Detection and Classification System for Assisting Visually Impaired People , 2013, 2013 IEEE International Conference on Computer Vision Workshops.