An Astute Assistive Device for Mobility and Object Recognition for Visually Impaired People

To provide autonomous navigation and orientation to visually impaired people, this article proposes a new electronic assistive device called the NavCane. The device helps people find obstacle-free paths in both indoor and outdoor settings. The NavCane also aids in the recognition of objects in an indoor setting. The advantage of the NavCane device is that it provides priority information about obstacles in the path without causing information overload. The priority information deduced by the system is transmitted to the user using tactile and auditory communication methods. Unlike existing electronic travel assistance systems which are limited to obstacle detection and path finding, the NavCane also helps users by recognizing objects in known indoor settings. The developed prototype is low cost and as a low power embedded device for obstacle detection and obstacle identification, it is an alternative to machine vision systems. It has a radio-frequency identification reader, ultrasonic sensors, a global system for mobile communication module, a global positioning system module, vibration motors, a gyroscope, a wet floor sensor, and a battery. To test the usefulness of the NavCane in mundane commuting, object recognition, and rehabilitation for visually impaired people, we assessed it with the help of 80 visually impaired people from a blind school and a home for elderly people. All the assessments were executed in controlled indoor and outdoor test environments with both a NavCane and a white cane. The experimental results show that the NavCane is an effective device for detecting of obstacles, ascending and descending staircases, navigating wet floors, and object recognition in environments that are known and unknown to the user. In addition, our evaluation results indicate that the NavCane improves the performance of obstacle-free navigation compared to a white cane.

[1]  Roberto Manduchi,et al.  Vibrotactile Guidance for Wayfinding of Blind Walkers , 2015, IEEE Transactions on Haptics.

[2]  Nikolaos G. Bourbakis,et al.  A Multimodal Interaction Scheme between a Blind User and the Tyflos Assistive Prototype , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[3]  Daniela Rus,et al.  Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  T. O. Mmatli Translating disability-related research into evidence-based advocacy: the role of people with disabilities , 2009, Disability and rehabilitation.

[5]  Cang Ye,et al.  Co-Robotic Cane: A New Robotic Navigation Aid for the Visually Impaired , 2016, IEEE Systems, Man, and Cybernetics Magazine.

[6]  L. Kay,et al.  Electronic Aids for Blind Persons : an Interdisciplinary Subject , 1984 .

[7]  Chung Hyuk Park,et al.  Telerobotic Haptic Exploration in Art Galleries and Museums for Individuals with Visual Impairments , 2015, IEEE Transactions on Haptics.

[8]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[9]  Xiao Zhongxin,et al.  A research study into the requirements of disabled residents for rehabilitation services in Beijing , 2007, Disability and rehabilitation.

[10]  Ramiro Velazquez,et al.  Computer-Based System for Simulating Visual Impairments , 2016 .

[11]  Cang Ye,et al.  3-D Object Recognition of a Robotic Navigation Aid for the Visually Impaired , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Bruno Ando,et al.  A Haptic Solution to Assist Visually Impaired in Mobility Tasks , 2015, IEEE Transactions on Human-Machine Systems.

[13]  Manjunatha Mahadevappa,et al.  Design, Development, and Clinical Evaluation of the Electronic Mobility Cane for Vision Rehabilitation , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  N. A. Bradley,et al.  Assistive Technology For Visually Impaired And Blind People , 2008 .

[15]  Iwan Ulrich,et al.  The GuideCane-applying mobile robot technologies to assist the visually impaired , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[16]  J. Borenstein,et al.  The NavBelt-a computerized travel aid for the blind based on mobile robotics technology , 1998, IEEE Transactions on Biomedical Engineering.

[17]  Maamar Bettayeb,et al.  A Navigation Aid for Blind People , 2011, J. Intell. Robotic Syst..

[18]  Kailas Patil,et al.  Design and Construction of Electronic Aid for Visually Impaired People , 2018, IEEE Transactions on Human-Machine Systems.

[19]  G. Balakrishnan,et al.  Design and Development of Tamil Sign Alphabets using Image Processing with Right Hand Palm to Aid Deaf-Dumb People , 2013 .

[20]  Cang Ye,et al.  An Indoor Wayfinding System Based on Geometric Features Aided Graph SLAM for the Visually Impaired , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  V. Freedman,et al.  A comparison of assistive technology and personal care in alleviating disability and unmet need. , 2003, The Gerontologist.

[22]  John A. Brabyn,et al.  New Developments in Mobility and Orientation Aids for the Blind , 1982, IEEE Transactions on Biomedical Engineering.

[23]  B. Ando,et al.  A Smart Multisensor Approach to Assist Blind People in Specific Urban Navigation Tasks , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  T. Ifukube,et al.  A blind mobility aid modeled after echolocation of bats , 1991, IEEE Transactions on Biomedical Engineering.

[25]  M V Ramana Rao Character recognition and its Announcing using artificial Neural Networks , 1995 .

[26]  Tetsuo Ono,et al.  CyARM: an alternative aid device for blind persons , 2005, CHI Extended Abstracts.

[27]  Gordon E. Legge,et al.  Designing Media for Visually-Impaired Users of Refreshable Touch Displays: Possibilities and Pitfalls , 2015, IEEE Transactions on Haptics.