Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device

This paper presents ALVU (Array of Lidars and Vibrotactile Units), a contactless, intuitive, hands-free, and discreet wearable device that allows visually impaired users to detect low- and high-hanging obstacles, as well as physical boundaries in their immediate environment. The solution allows for safe local navigation in both confined and open spaces by enabling the user to distinguish free space from obstacles. The device presented is composed of two parts: a sensor belt and a haptic strap. The sensor belt is an array of time-of-flight distance sensors worn around the front of a user’s waist, and the pulses of infrared light provide reliable and accurate measurements of the distances between the user and surrounding obstacles or surfaces. The haptic strap communicates the measured distances through an array of vibratory motors worn around the user’s upper abdomen, providing haptic feedback. The linear vibration motors are combined with a point-loaded pretensioned applicator to transmit isolated vibrations to the user. We validated the device’s capability in an extensive user study entailing 162 trials with 12 blind users. Users wearing the device successfully walked through hallways, avoided obstacles, and detected staircases.

[1]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[2]  A. R. Lam Vibrotactile Pattern Recognition on the Torso with One and Two Dimensional Displays , 2007 .

[3]  G. Medioni,et al.  RGB-D camera Based Navigation for the Visually Impaired , 2011 .

[4]  김만두,et al.  시력 손상과 시각 장애(Visual Impairment and Blindness) , 2011 .

[5]  Henrik I. Christensen,et al.  Guidance for human navigation using a vibro-tactile belt interface and robot-like motion planning , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Jan B. F. van Erp,et al.  Tactile Navigation Display , 2000, Haptic Human-Computer Interaction.

[7]  Shachar Maidenbaum,et al.  The "EyeCane", a new electronic travel aid for the blind: Technology, behavior & swift learning. , 2014, Restorative neurology and neuroscience.

[8]  João Barroso,et al.  Blind Navigation Support System based on Microsoft Kinect , 2012, DSAI.

[9]  M. Balakrishnan,et al.  'Smart' Cane for the Visually Impaired: Design and Controlled Field Testing of an Affordable Obstacle Detection System , 2010 .

[10]  B. Blasch,et al.  Practice Report: A Master Trainer Class for Professionals in Teaching the UltraCane Electronic Travel Device , 2005 .

[11]  石原 忍 Tests for Colour-Blindness , 1910, Nature.

[12]  Wolfram Burgard,et al.  Navigating blind people with a smart walker , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Tan Phu Vuong,et al.  A wearable assistive device for the blind using tongue-placed electrotactile display: Design and verification , 2013, 2013 International Conference on Control, Automation and Information Sciences (ICCAIS).

[14]  M. Asonuma,et al.  Basic study on obstacle avoidance system for the visually impaired , 2004, SICE 2004 Annual Conference.

[15]  Gérard G. Medioni,et al.  Wearable RGBD Indoor Navigation System for the Blind , 2014, ECCV Workshops.

[16]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Kalamullah Ramli,et al.  SEES: Concept and design of a smart environment explorer stick , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[18]  Takeshi Ando,et al.  A Haptic Interface “Force Blinker 2” for Navigation of the Visually Impaired , 2012, IEEE Transactions on Industrial Electronics.

[19]  Brian S. Hoyle,et al.  Mobility AT: The Batcane (UltraCane) , 2008 .

[20]  Nathan Ickes,et al.  A 0.6V, 8mW 3D Vision Processor for a Navigation Device for the Visually Impaired , 2016 .

[21]  Ramiro Velazquez,et al.  Wearable Assistive Devices for the Blind , 2016, ArXiv.

[22]  Juan Aceros,et al.  A necklace sonar with adjustable scope range for assisting the visually impaired , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Laura Giarré,et al.  Enabling independent navigation for visually impaired people through a wearable vision-based feedback system , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Koji Tsukada,et al.  ActiveBelt: Belt-Type Wearable Tactile Display for Directional Navigation , 2004, UbiComp.

[25]  Shrinivas J. Pundlik,et al.  Time to Collision and Collision Risk Estimation from Local Scale and Motion , 2011, ISVC.

[26]  Roberto Manduchi,et al.  (Computer) vision without sight , 2012, Commun. ACM.

[27]  J.B.F. van Erp,et al.  Providing directional information with tactile torso displays , 2003 .

[28]  Yingli Tian,et al.  RGB-D Sensor-Based Computer Vision Assistive Technology for Visually Impaired Persons , 2014 .

[29]  Gang Luo,et al.  Evaluation of a Portable Collision Warning Device for Patients With Peripheral Vision Loss in an Obstacle Course. , 2015, Investigative ophthalmology & visual science.

[30]  Manjunatha Mahadevappa,et al.  Design, Development, and Clinical Evaluation of the Electronic Mobility Cane for Vision Rehabilitation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.