Obstacle Avoidance for Visually Impaired Using Auto-Adaptive Thresholding on Kinect's Depth Image

Visually impaired people need assistance to navigate safely, especially in indoor environment. This research developed an obstacle avoidance system for visually impaired using Kinect's depth camera as the main vision device. A new approach called auto-adaptive thresholding is proposed to detect and to calculate the distance of obstacle from the user. The proposed method divides equally a depth image into three areas. It finds the most optimal threshold value automatically (auto) and vary among each of those areas (adaptive). Based on that threshold value, the distance of the closest obstacle for each area is determined by average function. To respond the existence of the obstacle, the system gives sound and voice feedback to the user through an earphone. The experimental result shows that execution time and error of the system in calculating the distance of the obstacle are 12.24 ms and 130.796 mm respectively. Evaluation with blind-folded persons indicates that the system could successfully guide them to avoid obstacles in real-time condition.

[1]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[2]  김만두,et al.  시력 손상과 시각 장애(Visual Impairment and Blindness) , 2011 .

[3]  Michael Lawo,et al.  Wearable Navigation System for the Visually Impaired and Blind People , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.

[4]  Kalevi Hyyppä,et al.  Obstacle avoidance using haptics and a laser rangefinder , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[5]  Ariffin Abdul Mutalib,et al.  Smart Cane: Assistive Cane for Visually-impaired People , 2011, ArXiv.

[6]  John Nicholson,et al.  RFID in robot-assisted indoor navigation for the visually impaired , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[7]  Harald Reiterer,et al.  NAVI - A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect , 2011, INTERACT.

[8]  Firas Ajil Jassim,et al.  Hybridization of Otsu Method and Median Filter for Color Image Segmentation , 2013, ArXiv.

[9]  Liang-Chia Chen,et al.  Object segmentation method using depth slicing and region growing algorithms , 2010 .

[10]  Andreas Riener,et al.  "Personal Radar": a self-governed support system to enhance environmental perception , 2012, BCS HCI.

[11]  Somnath koley,et al.  VOICE OPERATED OUTDOOR NAVIGATION SYSTEM FOR VISUALLY IMPAIRED PERSONS , 2012 .

[12]  J M Benjamin The laser cane. , 1974, Bulletin of prosthetics research.

[13]  M. Dellepiane,et al.  A Low-Cost Time-Critical Obstacle Avoidance System for the Visually Impaired , 2011 .

[14]  S. Yamaguchi,et al.  Kinect cane: An assistive system for the visually impaired based on three-dimensional object recognition , 2012, 2012 IEEE/SICE International Symposium on System Integration (SII).

[15]  Mitsuhiro Okayasu Newly developed walking apparatus for identification of obstructions by visually impaired people , 2010 .

[16]  Zhigang Zhu,et al.  KinDectect: Kinect Detecting Objects , 2012, ICCHP.

[17]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[18]  Steve Mann,et al.  Blind navigation with a wearable range camera and vibrotactile helmet , 2011, ACM Multimedia.

[19]  Per Ola Kristensson,et al.  Supporting blind navigation using depth sensing and sonification , 2013, UbiComp.