Wrist-mounted smartphone-based navigation device for visually impaired people using ultrasonic sensing

This paper presents a wrist-mounted wearable device for helping visually impaired people to avoid obstacles and to enable them to move around more efficiently than when using only a white cane. The device is designed to be worn on the wrist of the user and is connected to the user's smartphone. The detection algorithm is based on the information acquired from an ultrasonic sensor on the wristband and the accelerometer in the smartphone. The device has two detection modes; the ground level detection mode, and the above ground level detection mode. The ground level detection mode is used to detect obstacles (both bumps and holes) on the ground based on the distance data from the ultrasonic sensor together with the angle data of the user's arm from the accelerometer. The above ground level detection mode uses solely the information from the ultrasonic sensor. When an obstacle is found, the device alerts the user with both audio and haptic tactile feedback via the smartphone. Experimental results tested on blindfolded sighted individuals show that using the device with a white cane increases efficiency in avoiding obstacles. The results also show that the device is easy to learn.

[1]  Carlo Maria Medaglia,et al.  A RFID SYSTEM TO HELP VISUALLY IMPAIRED PEOPLE IN MOBILITY , 2007 .

[2]  S. Chumkamon,et al.  A blind navigation system using RFID for indoor environments , 2008, 2008 5th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology.

[3]  Jeffrey P. Bigham,et al.  VizWiz::LocateIt - enabling blind people to locate objects in their environment , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Surapol Vorapatratorn,et al.  iSonar: an obstacle warning device for the totally blind , 2014 .

[5]  Kumar Yelamarthi,et al.  RFID and GPS integrated navigation system for the visually impaired , 2010, 2010 53rd IEEE International Midwest Symposium on Circuits and Systems.

[6]  Luis Miguel Bergasa,et al.  Assisting the Visually Impaired: Obstacle Detection and Warning System by Acoustic Feedback , 2012, Sensors.

[7]  Jack M. Loomis,et al.  GPS-Based Navigation Systems for the Visually Impaired , 2001 .

[8]  Minoru Fukumi,et al.  Improving mobility for blind persons using video sunglasses , 2011, 2011 17th Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[9]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  M. Re,et al.  AudiNect: an aid for the autonomous navigation of visually impaired people, based on virtual interface , 2013 .

[11]  Daniel Thalmann,et al.  A wearable system for mobility improvement of visually impaired people , 2007, The Visual Computer.

[12]  Zoltan Juhasz,et al.  MOST-NNG: An Accessible GPS Navigation Application Integrated into the MObile Slate Talker (MOST) for the Blind , 2010, ICCHP.