AN OBSTACLE DETECTION SYSTEM USING DEPTH INFORMATION AND REGION GROWING FOR VISUALLY IMPAIRED PEOPLE

This study proposes an obstacle detection method based on depth information to aid the visually impaired people in avoiding obstacles as they move in an unfamiliar environment. Firstly, we have applied dilation of morphology and erosion of morphology to remove the crushing noise of the depth image and have used the Least Squares Method (LSM) in a quadratic polynomial to approximate floor curves and determine the floor height threshold in the V-disparity. Secondly, we have searched for dramatic changes depth value in accordance with the floor height threshold to find out suspicious stair edge points. Thirdly, we have used the Hough Transform to find out the location of the drop line. In order to strengthen the characteristics of the different objects to overcome the drawbacks of the region growing method, we have applied edge detection to remove the edge. Fourthly, we have used the floor height threshold and features of the ground to remove ground plane. And then our system has used the region growing method to label the tags on different objects. It has analyzed each object to determine whether the object is a stair. Fifthly, if the result is neither up stair nor down stair, we have used K-SVD algorithm to determine whether the object is people. Finally, the system has assisted the users to determine the stairs direction and obstacle distance through a voice prompt by Text To Speech (TTS). Experimental results show that the proposed system has great robustness and convenience.

[1]  Chong Sun,et al.  A real-time rear view camera based obstacle detection , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[2]  Xinxin Zhao,et al.  An obstacle detection algorithm based on U-V disparity map analysis , 2010, 2010 IEEE International Conference on Information Theory and Information Security.

[3]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Kwanghoon Sohn,et al.  Rear obstacle detection system based on depth from kinect , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[5]  Rémi Gribonval,et al.  Sparse approximations in signal and image processing , 2006, Signal Process..

[6]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[7]  Wei Sun,et al.  Obstacle Detection System for Visually Impaired People Based on Stereo Vision , 2010, 2010 Fourth International Conference on Genetic and Evolutionary Computing.

[8]  Norman Weyrich,et al.  A single camera based rear obstacle detection system , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[9]  Naim Dahnoun,et al.  Obstacle detection with 3D camera using U-V-Disparity , 2011, International Workshop on Systems, Signal Processing and their Applications, WOSSPA.

[10]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  A. M. Jubril,et al.  Obstacle detection system for visually impaired persons: Initial design and usability testing , 2013 .

[12]  Sangyoun Lee,et al.  Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind , 2014, Sensors.

[13]  Luis A. Guerrero,et al.  An Indoor Navigation System for the Visually Impaired , 2012, Sensors.

[14]  Liang-Gee Chen,et al.  An intelligent depth-based obstacle detection system for visually-impaired aid applications , 2012, 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services.

[15]  Ying Jie,et al.  Obstacle Detection of a Novel Travel Aid for Visual Impaired People , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.