Object detection and sensory feedback techniques in building smart cane for the visually impaired: an overview

People with vision impairment often encounter difficulties in situations that normal sighted people take for granted. Crossing roads and streets in busy environments with high traffic density is a major safety challenge. Investigation of proper technologies such as a smart cane that can provide navigational assistance to people with vision impairment has been an ongoing research topic of great interest. This paper provides a review of the current technology of smart canes and associated research topics. Specifically, the paper identifies a number of technical and application-oriented research challenges in designing smart cane systems. This includes the limitations of sensors, signal processing techniques, single sensors versus multiple sensors, adaptability standards, as well as pragmatic issues such as cost, size and usability. The paper then presents a survey of recent research focusing on various methods of object detection and sensory feedback systems, as well as the integration of other technology components that may be implemented in a smart cane system. Furthermore, the paper describes a summary of reported smart cane prototypes and categorizes them into various types such as how the object detection system is embedded on or separate from the cane, whether the system is able to detect static or dynamic objects, and what type of feedback is implemented into the system. In addition to defining common technical and application challenges involved in smart cane technology and developing an overview for both research and prototypes, the paper also provides an insight regarding the importance and need for safer and more effective object detection technology for the visually impaired community.

[1]  G. Gayathri,et al.  SMART WALKING STICK FOR VISUALLY IMPAIRED , 2015 .

[2]  H. S. Mewara,et al.  Challenges in design & deployment of assistive technology , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).

[3]  Diego P. Chacón-Troya,et al.  Design and Implementation of an Intelligent Cane, with Proximity Sensors, GPS Localization and GSM Feedback , 2018, 2018 IEEE Canadian Conference on Electrical & Computer Engineering (CCECE).

[4]  Jihong Liu,et al.  A Survey of Vision Aids for the Blind , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[5]  Ankit Agarwal,et al.  Ultrasonic Stick for Blind , 2015 .

[6]  Yoshihiro Niitsu,et al.  Detection and notification of dangerous obstacles and places for visually impaired persons using a smart cane , 2014, 2014 Seventh International Conference on Mobile Computing and Ubiquitous Networking (ICMU).

[7]  Rajesh Kannan Megalingam,et al.  Sound and touch based smart cane: Better walking experience for visually challenged , 2014, 2014 IEEE Canada International Humanitarian Technology Conference - (IHTC).

[8]  Shah Khusro,et al.  Technology-assisted white cane: evaluation and future directions , 2018, PeerJ.

[9]  Asim Majeed,et al.  Facial Recognition Cane for the Visually Impaired , 2017 .

[10]  Daniel Innala Ahlmark Haptic Navigation Aids for the Visually Impaired , 2016 .

[11]  E. Bell,et al.  Employment Outcomes for Blind and Visually Impaired Adults Abstract , 2015 .

[12]  Giva Andriana Mutiara,et al.  Smart guide extension for blind cane , 2016, 2016 4th International Conference on Information and Communication Technology (ICoICT).

[13]  Minho Lee,et al.  Smart Cane: Face Recognition System for Blind , 2015, HAI.

[14]  M. Balakrishnan,et al.  'Smart' Cane for the Visually Impaired: Design and Controlled Field Testing of an Affordable Obstacle Detection System , 2010 .

[15]  Uran Oh,et al.  Current and future mobile and wearable device use by people with visual impairments , 2014, CHI.

[16]  A. Jothimani,et al.  Object Identification for Visually Impaired , 2016 .

[17]  Giva Andriana Mutiara,et al.  Smart cane location guide for blind using GPS , 2017, 2017 5th International Conference on Information and Communication Technology (ICoIC7).

[18]  A. G. Dodds,et al.  The Nottingham Obstacle Detector: Development and Evaluation , 1981 .

[19]  Ruxandra Tapu,et al.  A computer vision system that ensure the autonomous navigation of blind people , 2013, 2013 E-Health and Bioengineering Conference (EHB).

[20]  Dorra Sellami Masmoudi,et al.  New electronic white cane for stair case detection and recognition using ultrasonic sensor , 2013 .

[21]  Ruxandra Tapu,et al.  When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition , 2016, Sensors.

[22]  Nobuo Ezaki,et al.  Kinect cane: Object recognition aids for the visually impaired , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[23]  Jayant Sakhardande,et al.  Smart Cane Assisted Mobility for the Visually Impaired , 2012 .

[24]  Bhupendra Singh,et al.  A Survey of Current Aids for Visually Impaired Persons , 2018, 2018 3rd International Conference On Internet of Things: Smart Innovation and Usages (IoT-SIU).