Assisted Guidance for the Blind Using the Kinect Device

This paper proposes a real-time system to provide location based guidance and obstacle avoidance of blind persons in indoor environments. The system integrates navigation features based on visual recognition of markers and the detection and classification of possible obstacles in front of the blind person. The system uses the Microsoft Kinect sensor to acquire RGB-D images of the scene. The RGB camera provides input for a real-time tracking algorithm which identifies a trained set of wall-mounted visual markers. The user's pose is estimated combining marker information with GIS data. Depth information is used to classify nearby obstacles. The results of experimental tests with two blind subjects are presented and discussed.

[1]  ZhangChenyang,et al.  RGB-D image-based detection of stairs, pedestrian crosswalks and traffic signs , 2014 .

[2]  Emily E O'Brien,et al.  A Detachable Electronic Device for Use With a Long White Cane to Assist With Mobility , 2014, Assistive technology : the official journal of RESNA.

[3]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[4]  Dieter Schmalstieg,et al.  Structured visual markers for indoor pathfinding , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[5]  Brandon T. Shrewsbury.  Providing haptic feedback using the kinect , 2011, ASSETS '11.

[6]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[7]  References , 1971 .

[8]  Shraga Shoval,et al.  Computerized obstacle avoidance systems for the blind and visually impaired , 2001 .

[9]  Dieter Schmalstieg,et al.  Indoor Positioning and Navigation with Camera Phones , 2009, IEEE Pervasive Computing.

[10]  João Barroso,et al.  Blind Navigation Support System based on Microsoft Kinect , 2012, DSAI.

[11]  Wilfried Philips,et al.  Indoor assistance for visually impaired people using a RGB-D camera , 2016, 2016 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[12]  Rosen Ivanov,et al.  Indoor navigation system for visually impaired , 2010, CompSysTech '10.

[13]  Orly Lahav,et al.  A Virtual Environment for People Who Are Blind - A Usability Study. , 2012, Journal of assistive technologies.

[14]  Jayanta Mukhopadhyay,et al.  Electronic Bracelet and Vision-Enabled Waist-Belt for Mobility of Visually Impaired People , 2014, Assistive technology : the official journal of RESNA.

[15]  Roberto Manduchi,et al.  Color Targets: Fiducials to Help Visually Impaired People Find Their Way by Camera Phone , 2007, EURASIP J. Image Video Process..

[16]  Kostas E. Bekris,et al.  Indoor Human Navigation Systems: A Survey , 2013, Interact. Comput..

[17]  Sazali Yaacob,et al.  Fuzzy image processing scheme for autonomous navigation of human blind , 2007, Appl. Soft Comput..

[18]  Shuihua Wang,et al.  RGB-D image-based detection of stairs, pedestrian crosswalks and traffic signs , 2014, J. Vis. Commun. Image Represent..

[19]  Nicolas Vuillerme,et al.  Real-Time Obstacle Detection System in Indoor Environment for the Visually Impaired Using Microsoft Kinect Sensor , 2016, J. Sensors.

[20]  Rabia Jafri,et al.  Obstacle Detection and Avoidance for the Visually Impaired in Indoors Environments Using Google's Project Tango Device , 2016, ICCHP.